Command line
python /home/saxelrod/Repo/projects/chemprop/chemprop/train.py --config_path /home/saxelrod/chemprop_cov_1/models/cp_cov_auc/config.json --data_path /home/saxelrod/chemprop_cov_1/train_full.csv --dataset_type classification
Args
{'activation': 'ReLU',
 'aggregation': 'mean',
 'aggregation_norm': 100,
 'atom_descriptors': None,
 'atom_descriptors_path': None,
 'atom_descriptors_size': 0,
 'atom_features_size': 0,
 'atom_messages': False,
 'batch_size': 50,
 'bias': False,
 'cache_cutoff': 10000,
 'checkpoint_dir': None,
 'checkpoint_path': None,
 'checkpoint_paths': None,
 'class_balance': True,
 'config_path': '/home/saxelrod/chemprop_cov_1/models/cp_cov_auc/config.json',
 'crossval_index_dir': None,
 'crossval_index_file': None,
 'crossval_index_sets': None,
 'cuda': True,
 'data_path': '/home/saxelrod/chemprop_cov_1/train_full.csv',
 'dataset_type': 'classification',
 'depth': 6,
 'device': device(type='cuda', index=0),
 'dropout': 0.25,
 'ensemble_size': 1,
 'epochs': 10000,
 'extra_metrics': [],
 'features_generator': None,
 'features_only': False,
 'features_path': None,
 'features_scaling': False,
 'features_size': None,
 'ffn_hidden_size': 1200,
 'ffn_num_layers': 2,
 'final_lr': 0.0001,
 'folds_file': None,
 'gpu': 0,
 'grad_clip': None,
 'hidden_size': 1200,
 'ignore_columns': None,
 'init_lr': 0.0001,
 'log_frequency': 10,
 'max_data_size': None,
 'max_lr': 0.001,
 'metric': 'auc',
 'metrics': ['auc'],
 'minimize_score': False,
 'mpn_shared': False,
 'multiclass_num_classes': 3,
 'no_cache_mol': False,
 'no_cuda': False,
 'no_features_scaling': True,
 'num_folds': 1,
 'num_lrs': 1,
 'num_tasks': 1,
 'num_workers': 8,
 'number_of_molecules': 1,
 'pytorch_seed': 0,
 'quiet': True,
 'save_dir': '/home/saxelrod/chemprop_cov_1/models/cp_cov_auc',
 'save_preds': False,
 'save_smiles_splits': False,
 'seed': 0,
 'separate_test_features_path': None,
 'separate_test_path': '/home/saxelrod/chemprop_cov_1/test_full.csv',
 'separate_val_features_path': None,
 'separate_val_path': '/home/saxelrod/chemprop_cov_1/val_full.csv',
 'show_individual_scores': False,
 'smiles_columns': [None],
 'split_sizes': (0.8, 0.1, 0.1),
 'split_type': 'random',
 'target_columns': None,
 'task_names': ['sars_cov_one_cl_protease_active'],
 'test': False,
 'test_fold_index': None,
 'train_data_size': None,
 'undirected': False,
 'use_input_features': False,
 'val_fold_index': None,
 'warmup_epochs': 2.0}
Loading data
Number of tasks = 1
Fold 0
Splitting data with seed 0
Class sizes
sars_cov_one_cl_protease_active 0: 99.84%, 1: 0.16%
Total size = 167,255 | train size = 167,255 | val size = 55,750 | test size = 55,756
With class_balance, effective train size = 550
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.25, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1200, bias=False)
        (W_h): Linear(in_features=1200, out_features=1200, bias=False)
        (W_o): Linear(in_features=1333, out_features=1200, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.25, inplace=False)
    (1): Linear(in_features=1200, out_features=1200, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.25, inplace=False)
    (4): Linear(in_features=1200, out_features=1, bias=True)
  )
)
Number of parameters = 4,659,601
Moving model to cuda
Epoch 0
Loss = 6.9489e-01, PNorm = 62.6741, GNorm = 1.2152, lr_0 = 1.0148e-04
Validation auc = 0.680692
Epoch 1
Loss = 6.7513e-01, PNorm = 62.6787, GNorm = 1.3320, lr_0 = 1.0283e-04
Validation auc = 0.683443
Epoch 2
Loss = 6.7865e-01, PNorm = 62.6830, GNorm = 1.4392, lr_0 = 1.0417e-04
Validation auc = 0.688289
Epoch 3
Loss = 6.5671e-01, PNorm = 62.6863, GNorm = 2.1955, lr_0 = 1.0552e-04
Validation auc = 0.692484
Epoch 4
Loss = 6.5470e-01, PNorm = 62.6901, GNorm = 0.9745, lr_0 = 1.0686e-04
Validation auc = 0.694587
Epoch 5
Loss = 6.5766e-01, PNorm = 62.6939, GNorm = 1.2736, lr_0 = 1.0821e-04
Validation auc = 0.691707
Epoch 6
Loss = 6.3790e-01, PNorm = 62.6983, GNorm = 0.9785, lr_0 = 1.0955e-04
Validation auc = 0.698235
Epoch 7
Loss = 6.3826e-01, PNorm = 62.7017, GNorm = 1.8960, lr_0 = 1.1090e-04
Validation auc = 0.688875
Epoch 8
Loss = 6.6711e-01, PNorm = 62.7048, GNorm = 1.0137, lr_0 = 1.1224e-04
Validation auc = 0.684620
Epoch 9
Loss = 5.9079e-01, PNorm = 62.7090, GNorm = 0.8993, lr_0 = 1.1359e-04
Loss = 6.4348e-01, PNorm = 62.7139, GNorm = 1.1735, lr_0 = 1.1493e-04
Validation auc = 0.688219
Epoch 10
Loss = 6.2893e-01, PNorm = 62.7181, GNorm = 2.6596, lr_0 = 1.1628e-04
Validation auc = 0.682780
Epoch 11
Loss = 6.0967e-01, PNorm = 62.7224, GNorm = 0.9322, lr_0 = 1.1762e-04
Validation auc = 0.685082
Epoch 12
Loss = 6.1995e-01, PNorm = 62.7274, GNorm = 1.1415, lr_0 = 1.1897e-04
Validation auc = 0.693638
Epoch 13
Loss = 6.3254e-01, PNorm = 62.7325, GNorm = 4.1442, lr_0 = 1.2031e-04
Validation auc = 0.693403
Epoch 14
Loss = 6.0210e-01, PNorm = 62.7377, GNorm = 1.1648, lr_0 = 1.2166e-04
Validation auc = 0.684591
Epoch 15
Loss = 6.1177e-01, PNorm = 62.7441, GNorm = 1.3126, lr_0 = 1.2300e-04
Validation auc = 0.680215
Epoch 16
Loss = 5.8475e-01, PNorm = 62.7504, GNorm = 1.4331, lr_0 = 1.2435e-04
Validation auc = 0.684214
Epoch 17
Loss = 5.7067e-01, PNorm = 62.7577, GNorm = 2.9107, lr_0 = 1.2570e-04
Validation auc = 0.695315
Epoch 18
Loss = 5.6793e-01, PNorm = 62.7638, GNorm = 0.9550, lr_0 = 1.2704e-04
Validation auc = 0.684234
Epoch 19
Loss = 6.3893e-01, PNorm = 62.7713, GNorm = 1.7825, lr_0 = 1.2839e-04
Loss = 5.9847e-01, PNorm = 62.7781, GNorm = 1.1045, lr_0 = 1.2973e-04
Validation auc = 0.685235
Epoch 20
Loss = 6.0791e-01, PNorm = 62.7849, GNorm = 0.8882, lr_0 = 1.3108e-04
Validation auc = 0.708555
Epoch 21
Loss = 6.0533e-01, PNorm = 62.7915, GNorm = 1.2534, lr_0 = 1.3242e-04
Validation auc = 0.694668
Epoch 22
Loss = 5.6964e-01, PNorm = 62.7996, GNorm = 1.9438, lr_0 = 1.3377e-04
Validation auc = 0.698996
Epoch 23
Loss = 6.4193e-01, PNorm = 62.8059, GNorm = 2.5589, lr_0 = 1.3511e-04
Validation auc = 0.695780
Epoch 24
Loss = 5.8524e-01, PNorm = 62.8119, GNorm = 1.0484, lr_0 = 1.3646e-04
Validation auc = 0.709139
Epoch 25
Loss = 5.5810e-01, PNorm = 62.8202, GNorm = 1.2672, lr_0 = 1.3780e-04
Validation auc = 0.699161
Epoch 26
Loss = 5.7894e-01, PNorm = 62.8272, GNorm = 1.5072, lr_0 = 1.3915e-04
Validation auc = 0.697302
Epoch 27
Loss = 5.3670e-01, PNorm = 62.8364, GNorm = 1.2615, lr_0 = 1.4049e-04
Validation auc = 0.709005
Epoch 28
Loss = 5.2169e-01, PNorm = 62.8472, GNorm = 0.9583, lr_0 = 1.4184e-04
Validation auc = 0.695812
Epoch 29
Loss = 6.1038e-01, PNorm = 62.8558, GNorm = 2.2825, lr_0 = 1.4318e-04
Loss = 5.5755e-01, PNorm = 62.8635, GNorm = 0.8486, lr_0 = 1.4453e-04
Validation auc = 0.707390
Epoch 30
Loss = 5.6274e-01, PNorm = 62.8716, GNorm = 1.1200, lr_0 = 1.4587e-04
Validation auc = 0.692274
Epoch 31
Loss = 5.3334e-01, PNorm = 62.8819, GNorm = 1.5999, lr_0 = 1.4722e-04
Validation auc = 0.699788
Epoch 32
Loss = 5.6377e-01, PNorm = 62.8913, GNorm = 1.0927, lr_0 = 1.4857e-04
Validation auc = 0.702626
Epoch 33
Loss = 5.5746e-01, PNorm = 62.8993, GNorm = 1.9304, lr_0 = 1.4991e-04
Validation auc = 0.697500
Epoch 34
Loss = 5.9125e-01, PNorm = 62.9090, GNorm = 2.6108, lr_0 = 1.5126e-04
Validation auc = 0.693351
Epoch 35
Loss = 5.4940e-01, PNorm = 62.9184, GNorm = 1.1361, lr_0 = 1.5260e-04
Validation auc = 0.717589
Epoch 36
Loss = 5.4559e-01, PNorm = 62.9281, GNorm = 2.5716, lr_0 = 1.5395e-04
Validation auc = 0.686771
Epoch 37
Loss = 5.9020e-01, PNorm = 62.9376, GNorm = 3.3284, lr_0 = 1.5529e-04
Validation auc = 0.702446
Epoch 38
Loss = 5.7017e-01, PNorm = 62.9486, GNorm = 0.9664, lr_0 = 1.5664e-04
Validation auc = 0.707060
Epoch 39
Loss = 3.9324e-01, PNorm = 62.9627, GNorm = 1.2032, lr_0 = 1.5798e-04
Loss = 5.5548e-01, PNorm = 62.9744, GNorm = 2.1236, lr_0 = 1.5933e-04
Validation auc = 0.683392
Epoch 40
Loss = 5.1914e-01, PNorm = 62.9862, GNorm = 3.1418, lr_0 = 1.6067e-04
Validation auc = 0.710661
Epoch 41
Loss = 5.2605e-01, PNorm = 62.9971, GNorm = 4.6908, lr_0 = 1.6202e-04
Validation auc = 0.716530
Epoch 42
Loss = 5.3103e-01, PNorm = 63.0077, GNorm = 2.2572, lr_0 = 1.6336e-04
Validation auc = 0.699338
Epoch 43
Loss = 4.7773e-01, PNorm = 63.0215, GNorm = 0.8719, lr_0 = 1.6471e-04
Validation auc = 0.710957
Epoch 44
Loss = 5.3878e-01, PNorm = 63.0343, GNorm = 7.1650, lr_0 = 1.6605e-04
Validation auc = 0.677450
Epoch 45
Loss = 4.5937e-01, PNorm = 63.0469, GNorm = 0.9924, lr_0 = 1.6740e-04
Validation auc = 0.720360
Epoch 46
Loss = 4.8403e-01, PNorm = 63.0604, GNorm = 0.9996, lr_0 = 1.6874e-04
Validation auc = 0.702319
Epoch 47
Loss = 4.5847e-01, PNorm = 63.0727, GNorm = 1.1594, lr_0 = 1.7009e-04
Validation auc = 0.726303
Epoch 48
Loss = 5.7423e-01, PNorm = 63.0847, GNorm = 1.9413, lr_0 = 1.7143e-04
Validation auc = 0.702093
Epoch 49
Loss = 5.5958e-01, PNorm = 63.0982, GNorm = 3.9568, lr_0 = 1.7278e-04
Loss = 5.0623e-01, PNorm = 63.1122, GNorm = 3.2887, lr_0 = 1.7413e-04
Validation auc = 0.704848
Epoch 50
Loss = 5.4384e-01, PNorm = 63.1243, GNorm = 2.8780, lr_0 = 1.7547e-04
Validation auc = 0.709559
Epoch 51
Loss = 4.9719e-01, PNorm = 63.1404, GNorm = 1.2558, lr_0 = 1.7682e-04
Validation auc = 0.702521
Epoch 52
Loss = 4.6714e-01, PNorm = 63.1562, GNorm = 1.9271, lr_0 = 1.7816e-04
Validation auc = 0.721402
Epoch 53
Loss = 4.5391e-01, PNorm = 63.1707, GNorm = 1.3738, lr_0 = 1.7951e-04
Validation auc = 0.707359
Epoch 54
Loss = 5.2093e-01, PNorm = 63.1861, GNorm = 1.2055, lr_0 = 1.8085e-04
Validation auc = 0.711273
Epoch 55
Loss = 4.8270e-01, PNorm = 63.2002, GNorm = 1.2756, lr_0 = 1.8220e-04
Validation auc = 0.706434
Epoch 56
Loss = 4.4921e-01, PNorm = 63.2209, GNorm = 4.9560, lr_0 = 1.8354e-04
Validation auc = 0.713201
Epoch 57
Loss = 4.9976e-01, PNorm = 63.2371, GNorm = 4.0941, lr_0 = 1.8489e-04
Validation auc = 0.707038
Epoch 58
Loss = 3.9098e-01, PNorm = 63.2538, GNorm = 2.4849, lr_0 = 1.8623e-04
Validation auc = 0.704502
Epoch 59
Loss = 4.8675e-01, PNorm = 63.2718, GNorm = 2.5525, lr_0 = 1.8758e-04
Loss = 4.3734e-01, PNorm = 63.2897, GNorm = 2.9202, lr_0 = 1.8892e-04
Validation auc = 0.707703
Epoch 60
Loss = 4.2324e-01, PNorm = 63.3072, GNorm = 4.9810, lr_0 = 1.9027e-04
Validation auc = 0.709870
Epoch 61
Loss = 4.6264e-01, PNorm = 63.3234, GNorm = 4.9699, lr_0 = 1.9161e-04
Validation auc = 0.719916
Epoch 62
Loss = 4.3103e-01, PNorm = 63.3410, GNorm = 2.5015, lr_0 = 1.9296e-04
Validation auc = 0.720212
Epoch 63
Loss = 4.2717e-01, PNorm = 63.3602, GNorm = 5.3086, lr_0 = 1.9430e-04
Validation auc = 0.715579
Epoch 64
Loss = 3.8647e-01, PNorm = 63.3817, GNorm = 1.9920, lr_0 = 1.9565e-04
Validation auc = 0.711734
Epoch 65
Loss = 4.3913e-01, PNorm = 63.3997, GNorm = 5.9564, lr_0 = 1.9700e-04
Validation auc = 0.705292
Epoch 66
Loss = 4.3791e-01, PNorm = 63.4210, GNorm = 3.7466, lr_0 = 1.9834e-04
Validation auc = 0.715711
Epoch 67
Loss = 4.3205e-01, PNorm = 63.4391, GNorm = 2.6536, lr_0 = 1.9969e-04
Validation auc = 0.677226
Epoch 68
Loss = 4.1131e-01, PNorm = 63.4587, GNorm = 5.1987, lr_0 = 2.0103e-04
Validation auc = 0.700611
Epoch 69
Loss = 3.4579e-01, PNorm = 63.4811, GNorm = 4.0901, lr_0 = 2.0238e-04
Loss = 4.9158e-01, PNorm = 63.4969, GNorm = 1.7028, lr_0 = 2.0372e-04
Validation auc = 0.714694
Epoch 70
Loss = 4.3256e-01, PNorm = 63.5127, GNorm = 2.5045, lr_0 = 2.0507e-04
Validation auc = 0.716765
Epoch 71
Loss = 3.8961e-01, PNorm = 63.5383, GNorm = 1.5211, lr_0 = 2.0641e-04
Validation auc = 0.711848
Epoch 72
Loss = 4.6671e-01, PNorm = 63.5599, GNorm = 3.3164, lr_0 = 2.0776e-04
Validation auc = 0.721713
Epoch 73
Loss = 3.6324e-01, PNorm = 63.5806, GNorm = 2.5084, lr_0 = 2.0910e-04
Validation auc = 0.714701
Epoch 74
Loss = 3.8289e-01, PNorm = 63.6025, GNorm = 2.0681, lr_0 = 2.1045e-04
Validation auc = 0.731290
Epoch 75
Loss = 3.6841e-01, PNorm = 63.6238, GNorm = 5.4534, lr_0 = 2.1179e-04
Validation auc = 0.699609
Epoch 76
Loss = 3.6646e-01, PNorm = 63.6438, GNorm = 1.2954, lr_0 = 2.1314e-04
Validation auc = 0.719581
Epoch 77
Loss = 4.0122e-01, PNorm = 63.6672, GNorm = 3.0711, lr_0 = 2.1448e-04
Validation auc = 0.712922
Epoch 78
Loss = 2.5994e-01, PNorm = 63.6889, GNorm = 2.8286, lr_0 = 2.1583e-04
Validation auc = 0.703993
Epoch 79
Loss = 3.2580e-01, PNorm = 63.7127, GNorm = 2.2291, lr_0 = 2.1717e-04
Loss = 3.6861e-01, PNorm = 63.7320, GNorm = 2.8584, lr_0 = 2.1852e-04
Validation auc = 0.701916
Epoch 80
Loss = 3.5228e-01, PNorm = 63.7548, GNorm = 2.8639, lr_0 = 2.1987e-04
Validation auc = 0.702395
Epoch 81
Loss = 4.0477e-01, PNorm = 63.7779, GNorm = 4.2162, lr_0 = 2.2121e-04
Validation auc = 0.712340
Epoch 82
Loss = 3.7639e-01, PNorm = 63.7985, GNorm = 1.3809, lr_0 = 2.2256e-04
Validation auc = 0.684337
Epoch 83
Loss = 3.6879e-01, PNorm = 63.8244, GNorm = 2.2628, lr_0 = 2.2390e-04
Validation auc = 0.705594
Epoch 84
Loss = 3.2048e-01, PNorm = 63.8510, GNorm = 3.3893, lr_0 = 2.2525e-04
Validation auc = 0.704506
Epoch 85
Loss = 2.7678e-01, PNorm = 63.8776, GNorm = 4.6241, lr_0 = 2.2659e-04
Validation auc = 0.701289
Epoch 86
Loss = 2.7958e-01, PNorm = 63.9006, GNorm = 1.9797, lr_0 = 2.2794e-04
Validation auc = 0.707890
Epoch 87
Loss = 4.0062e-01, PNorm = 63.9262, GNorm = 6.2806, lr_0 = 2.2928e-04
Validation auc = 0.734598
Epoch 88
Loss = 4.2594e-01, PNorm = 63.9503, GNorm = 8.4550, lr_0 = 2.3063e-04
Validation auc = 0.705208
Epoch 89
Loss = 2.9633e-01, PNorm = 63.9746, GNorm = 4.3451, lr_0 = 2.3197e-04
Loss = 3.1024e-01, PNorm = 64.0012, GNorm = 5.0772, lr_0 = 2.3332e-04
Validation auc = 0.717741
Epoch 90
Loss = 3.0355e-01, PNorm = 64.0287, GNorm = 3.6161, lr_0 = 2.3466e-04
Validation auc = 0.715599
Epoch 91
Loss = 3.1284e-01, PNorm = 64.0564, GNorm = 5.1305, lr_0 = 2.3601e-04
Validation auc = 0.732484
Epoch 92
Loss = 3.5020e-01, PNorm = 64.0827, GNorm = 2.2998, lr_0 = 2.3735e-04
Validation auc = 0.695703
Epoch 93
Loss = 2.9821e-01, PNorm = 64.1072, GNorm = 2.9825, lr_0 = 2.3870e-04
Validation auc = 0.715322
Epoch 94
Loss = 3.4072e-01, PNorm = 64.1304, GNorm = 4.2857, lr_0 = 2.4004e-04
Validation auc = 0.717049
Epoch 95
Loss = 3.2128e-01, PNorm = 64.1563, GNorm = 5.7749, lr_0 = 2.4139e-04
Validation auc = 0.719450
Epoch 96
Loss = 4.2797e-01, PNorm = 64.1787, GNorm = 2.9533, lr_0 = 2.4274e-04
Validation auc = 0.719429
Epoch 97
Loss = 2.9642e-01, PNorm = 64.2013, GNorm = 3.2950, lr_0 = 2.4408e-04
Validation auc = 0.731871
Epoch 98
Loss = 3.3993e-01, PNorm = 64.2281, GNorm = 1.5565, lr_0 = 2.4543e-04
Validation auc = 0.712994
Epoch 99
Loss = 3.5938e-01, PNorm = 64.2521, GNorm = 5.0030, lr_0 = 2.4677e-04
Loss = 2.7005e-01, PNorm = 64.2785, GNorm = 3.2384, lr_0 = 2.4812e-04
Validation auc = 0.713511
Epoch 100
Loss = 2.4973e-01, PNorm = 64.3081, GNorm = 2.3145, lr_0 = 2.4946e-04
Validation auc = 0.716956
Epoch 101
Loss = 3.5202e-01, PNorm = 64.3319, GNorm = 3.1400, lr_0 = 2.5081e-04
Validation auc = 0.687510
Epoch 102
Loss = 3.5466e-01, PNorm = 64.3566, GNorm = 2.1113, lr_0 = 2.5215e-04
Validation auc = 0.729338
Epoch 103
Loss = 2.8041e-01, PNorm = 64.3869, GNorm = 2.0382, lr_0 = 2.5350e-04
Validation auc = 0.718556
Epoch 104
Loss = 2.2837e-01, PNorm = 64.4141, GNorm = 2.9669, lr_0 = 2.5484e-04
Validation auc = 0.729931
Epoch 105
Loss = 2.0618e-01, PNorm = 64.4424, GNorm = 3.2610, lr_0 = 2.5619e-04
Validation auc = 0.712586
Epoch 106
Loss = 1.8043e-01, PNorm = 64.4662, GNorm = 2.2060, lr_0 = 2.5753e-04
Validation auc = 0.714363
Epoch 107
Loss = 2.2275e-01, PNorm = 64.4909, GNorm = 3.2436, lr_0 = 2.5888e-04
Validation auc = 0.710110
Epoch 108
Loss = 2.4853e-01, PNorm = 64.5165, GNorm = 2.8480, lr_0 = 2.6022e-04
Validation auc = 0.703205
Epoch 109
Loss = 2.5287e-01, PNorm = 64.5441, GNorm = 2.6303, lr_0 = 2.6157e-04
Loss = 2.2291e-01, PNorm = 64.5718, GNorm = 3.7203, lr_0 = 2.6291e-04
Validation auc = 0.717450
Epoch 110
Loss = 2.3109e-01, PNorm = 64.5973, GNorm = 5.4650, lr_0 = 2.6426e-04
Validation auc = 0.699609
Epoch 111
Loss = 2.2338e-01, PNorm = 64.6269, GNorm = 7.7908, lr_0 = 2.6561e-04
Validation auc = 0.730505
Epoch 112
Loss = 1.8764e-01, PNorm = 64.6580, GNorm = 2.8575, lr_0 = 2.6695e-04
Validation auc = 0.721712
Epoch 113
Loss = 2.5195e-01, PNorm = 64.6919, GNorm = 2.8684, lr_0 = 2.6830e-04
Validation auc = 0.713739
Epoch 114
Loss = 2.9640e-01, PNorm = 64.7128, GNorm = 5.9300, lr_0 = 2.6964e-04
Validation auc = 0.719343
Epoch 115
Loss = 2.2453e-01, PNorm = 64.7396, GNorm = 3.0682, lr_0 = 2.7099e-04
Validation auc = 0.703480
Epoch 116
Loss = 1.9421e-01, PNorm = 64.7672, GNorm = 6.0499, lr_0 = 2.7233e-04
Validation auc = 0.737915
Epoch 117
Loss = 2.1220e-01, PNorm = 64.7988, GNorm = 3.4419, lr_0 = 2.7368e-04
Validation auc = 0.729068
Epoch 118
Loss = 1.6525e-01, PNorm = 64.8261, GNorm = 2.7980, lr_0 = 2.7502e-04
Validation auc = 0.729304
Epoch 119
Loss = 1.3780e-01, PNorm = 64.8523, GNorm = 2.3283, lr_0 = 2.7637e-04
Loss = 2.4030e-01, PNorm = 64.8804, GNorm = 4.1630, lr_0 = 2.7771e-04
Validation auc = 0.720000
Epoch 120
Loss = 1.9372e-01, PNorm = 64.9086, GNorm = 3.4778, lr_0 = 2.7906e-04
Validation auc = 0.708303
Epoch 121
Loss = 2.4135e-01, PNorm = 64.9327, GNorm = 1.5699, lr_0 = 2.8040e-04
Validation auc = 0.720241
Epoch 122
Loss = 2.5903e-01, PNorm = 64.9524, GNorm = 7.7513, lr_0 = 2.8175e-04
Validation auc = 0.719637
Epoch 123
Loss = 2.2949e-01, PNorm = 64.9769, GNorm = 2.9637, lr_0 = 2.8309e-04
Validation auc = 0.723470
Epoch 124
Loss = 2.0888e-01, PNorm = 65.0060, GNorm = 4.4162, lr_0 = 2.8444e-04
Validation auc = 0.726817
Epoch 125
Loss = 2.7060e-01, PNorm = 65.0275, GNorm = 2.0571, lr_0 = 2.8578e-04
Validation auc = 0.700970
Epoch 126
Loss = 1.8819e-01, PNorm = 65.0468, GNorm = 1.1749, lr_0 = 2.8713e-04
Validation auc = 0.715946
Epoch 127
Loss = 1.7824e-01, PNorm = 65.0793, GNorm = 2.4149, lr_0 = 2.8848e-04
Validation auc = 0.725327
Epoch 128
Loss = 3.5113e-01, PNorm = 65.1068, GNorm = 8.9535, lr_0 = 2.8982e-04
Validation auc = 0.727137
Epoch 129
Loss = 1.2677e-01, PNorm = 65.1300, GNorm = 1.6798, lr_0 = 2.9117e-04
Loss = 1.6973e-01, PNorm = 65.1597, GNorm = 4.0591, lr_0 = 2.9251e-04
Validation auc = 0.705712
Epoch 130
Loss = 2.1920e-01, PNorm = 65.1869, GNorm = 4.0886, lr_0 = 2.9386e-04
Validation auc = 0.722151
Epoch 131
Loss = 1.8996e-01, PNorm = 65.2109, GNorm = 6.4415, lr_0 = 2.9520e-04
Validation auc = 0.722179
Epoch 132
Loss = 1.8917e-01, PNorm = 65.2340, GNorm = 2.7908, lr_0 = 2.9655e-04
Validation auc = 0.731590
Epoch 133
Loss = 2.1770e-01, PNorm = 65.2638, GNorm = 4.1547, lr_0 = 2.9789e-04
Validation auc = 0.735555
Epoch 134
Loss = 2.0818e-01, PNorm = 65.2898, GNorm = 7.0653, lr_0 = 2.9924e-04
Validation auc = 0.725987
Epoch 135
Loss = 2.6719e-01, PNorm = 65.3212, GNorm = 4.1677, lr_0 = 3.0058e-04
Validation auc = 0.702648
Epoch 136
Loss = 2.3470e-01, PNorm = 65.3546, GNorm = 2.0280, lr_0 = 3.0193e-04
Validation auc = 0.732584
Epoch 137
Loss = 2.7607e-01, PNorm = 65.3825, GNorm = 7.5347, lr_0 = 3.0327e-04
Validation auc = 0.707918
Epoch 138
Loss = 1.9563e-01, PNorm = 65.4116, GNorm = 1.8656, lr_0 = 3.0462e-04
Validation auc = 0.714476
Epoch 139
Loss = 1.6799e-01, PNorm = 65.4432, GNorm = 1.5329, lr_0 = 3.0596e-04
Loss = 1.7302e-01, PNorm = 65.4707, GNorm = 1.8978, lr_0 = 3.0731e-04
Validation auc = 0.722816
Epoch 140
Loss = 2.7014e-01, PNorm = 65.4935, GNorm = 4.5077, lr_0 = 3.0865e-04
Validation auc = 0.701648
Epoch 141
Loss = 2.3159e-01, PNorm = 65.5180, GNorm = 3.4461, lr_0 = 3.1000e-04
Validation auc = 0.729204
Epoch 142
Loss = 2.1802e-01, PNorm = 65.5476, GNorm = 1.8986, lr_0 = 3.1135e-04
Validation auc = 0.730795
Epoch 143
Loss = 1.6765e-01, PNorm = 65.5754, GNorm = 2.1584, lr_0 = 3.1269e-04
Validation auc = 0.733553
Epoch 144
Loss = 1.2695e-01, PNorm = 65.6031, GNorm = 3.4854, lr_0 = 3.1404e-04
Validation auc = 0.726038
Epoch 145
Loss = 1.5194e-01, PNorm = 65.6284, GNorm = 4.0045, lr_0 = 3.1538e-04
Validation auc = 0.723286
Epoch 146
Loss = 1.9007e-01, PNorm = 65.6491, GNorm = 5.1720, lr_0 = 3.1673e-04
Validation auc = 0.720642
Epoch 147
Loss = 1.5405e-01, PNorm = 65.6741, GNorm = 2.4946, lr_0 = 3.1807e-04
Validation auc = 0.737267
Epoch 148
Loss = 1.3688e-01, PNorm = 65.7042, GNorm = 4.2779, lr_0 = 3.1942e-04
Validation auc = 0.740710
Epoch 149
Loss = 9.5926e-02, PNorm = 65.7305, GNorm = 2.2443, lr_0 = 3.2076e-04
Loss = 1.4077e-01, PNorm = 65.7573, GNorm = 2.7093, lr_0 = 3.2211e-04
Validation auc = 0.720448
Epoch 150
Loss = 1.2965e-01, PNorm = 65.7842, GNorm = 1.0842, lr_0 = 3.2345e-04
Validation auc = 0.726774
Epoch 151
Loss = 1.1609e-01, PNorm = 65.8084, GNorm = 1.9540, lr_0 = 3.2480e-04
Validation auc = 0.729984
Epoch 152
Loss = 1.6381e-01, PNorm = 65.8369, GNorm = 1.6981, lr_0 = 3.2614e-04
Validation auc = 0.721714
Epoch 153
Loss = 1.9749e-01, PNorm = 65.8589, GNorm = 3.8555, lr_0 = 3.2749e-04
Validation auc = 0.714917
Epoch 154
Loss = 1.8282e-01, PNorm = 65.8853, GNorm = 2.7301, lr_0 = 3.2883e-04
Validation auc = 0.731823
Epoch 155
Loss = 1.6179e-01, PNorm = 65.9159, GNorm = 2.1140, lr_0 = 3.3018e-04
Validation auc = 0.735911
Epoch 156
Loss = 1.7280e-01, PNorm = 65.9444, GNorm = 4.9325, lr_0 = 3.3152e-04
Validation auc = 0.726194
Epoch 157
Loss = 1.7159e-01, PNorm = 65.9693, GNorm = 2.9105, lr_0 = 3.3287e-04
Validation auc = 0.725152
Epoch 158
Loss = 1.2698e-01, PNorm = 65.9953, GNorm = 1.6796, lr_0 = 3.3422e-04
Validation auc = 0.726360
Epoch 159
Loss = 1.1707e-01, PNorm = 66.0184, GNorm = 1.8608, lr_0 = 3.3556e-04
Loss = 1.4081e-01, PNorm = 66.0468, GNorm = 3.2182, lr_0 = 3.3691e-04
Validation auc = 0.717932
Epoch 160
Loss = 1.3510e-01, PNorm = 66.0742, GNorm = 3.3253, lr_0 = 3.3825e-04
Validation auc = 0.734417
Epoch 161
Loss = 1.3543e-01, PNorm = 66.0994, GNorm = 2.2703, lr_0 = 3.3960e-04
Validation auc = 0.737738
Epoch 162
Loss = 1.3885e-01, PNorm = 66.1296, GNorm = 1.0989, lr_0 = 3.4094e-04
Validation auc = 0.720807
Epoch 163
Loss = 1.2672e-01, PNorm = 66.1577, GNorm = 4.1232, lr_0 = 3.4229e-04
Validation auc = 0.730033
Epoch 164
Loss = 1.2442e-01, PNorm = 66.1866, GNorm = 3.2137, lr_0 = 3.4363e-04
Validation auc = 0.724089
Epoch 165
Loss = 1.4529e-01, PNorm = 66.2185, GNorm = 3.1756, lr_0 = 3.4498e-04
Validation auc = 0.738764
Epoch 166
Loss = 1.4034e-01, PNorm = 66.2531, GNorm = 2.0424, lr_0 = 3.4632e-04
Validation auc = 0.732566
Epoch 167
Loss = 1.4591e-01, PNorm = 66.2867, GNorm = 3.4872, lr_0 = 3.4767e-04
Validation auc = 0.737330
Epoch 168
Loss = 1.4094e-01, PNorm = 66.3168, GNorm = 2.9078, lr_0 = 3.4901e-04
Validation auc = 0.731172
Epoch 169
Loss = 2.4834e-01, PNorm = 66.3470, GNorm = 7.1449, lr_0 = 3.5036e-04
Loss = 1.3782e-01, PNorm = 66.3758, GNorm = 2.9604, lr_0 = 3.5170e-04
Validation auc = 0.731498
Epoch 170
Loss = 1.3319e-01, PNorm = 66.4057, GNorm = 0.8812, lr_0 = 3.5305e-04
Validation auc = 0.756238
Epoch 171
Loss = 2.9746e-01, PNorm = 66.4339, GNorm = 1.6878, lr_0 = 3.5439e-04
Validation auc = 0.705957
Epoch 172
Loss = 2.3714e-01, PNorm = 66.4706, GNorm = 4.3010, lr_0 = 3.5574e-04
Validation auc = 0.722065
Epoch 173
Loss = 1.8933e-01, PNorm = 66.5191, GNorm = 5.7526, lr_0 = 3.5709e-04
Validation auc = 0.724456
Epoch 174
Loss = 1.6252e-01, PNorm = 66.5561, GNorm = 3.0394, lr_0 = 3.5843e-04
Validation auc = 0.731218
Epoch 175
Loss = 9.1588e-02, PNorm = 66.5928, GNorm = 2.1081, lr_0 = 3.5978e-04
Validation auc = 0.716797
Epoch 176
Loss = 1.4131e-01, PNorm = 66.6230, GNorm = 2.2604, lr_0 = 3.6112e-04
Validation auc = 0.693647
Epoch 177
Loss = 1.2936e-01, PNorm = 66.6493, GNorm = 1.9604, lr_0 = 3.6247e-04
Validation auc = 0.709921
Epoch 178
Loss = 1.3677e-01, PNorm = 66.6759, GNorm = 3.8433, lr_0 = 3.6381e-04
Validation auc = 0.727536
Epoch 179
Loss = 1.3472e-01, PNorm = 66.7056, GNorm = 3.0877, lr_0 = 3.6516e-04
Loss = 1.1891e-01, PNorm = 66.7382, GNorm = 1.5620, lr_0 = 3.6650e-04
Validation auc = 0.724460
Epoch 180
Loss = 1.5869e-01, PNorm = 66.7713, GNorm = 2.2101, lr_0 = 3.6785e-04
Validation auc = 0.731589
Epoch 181
Loss = 8.3485e-02, PNorm = 66.8061, GNorm = 1.9420, lr_0 = 3.6919e-04
Validation auc = 0.722454
Epoch 182
Loss = 1.4943e-01, PNorm = 66.8373, GNorm = 3.4308, lr_0 = 3.7054e-04
Validation auc = 0.737894
Epoch 183
Loss = 1.0758e-01, PNorm = 66.8628, GNorm = 4.1509, lr_0 = 3.7188e-04
Validation auc = 0.703901
Epoch 184
Loss = 1.3301e-01, PNorm = 66.8949, GNorm = 3.2101, lr_0 = 3.7323e-04
Validation auc = 0.720816
Epoch 185
Loss = 1.2550e-01, PNorm = 66.9229, GNorm = 2.7461, lr_0 = 3.7457e-04
Validation auc = 0.718134
Epoch 186
Loss = 1.4384e-01, PNorm = 66.9495, GNorm = 1.8461, lr_0 = 3.7592e-04
Validation auc = 0.713802
Epoch 187
Loss = 8.8001e-02, PNorm = 66.9758, GNorm = 0.9239, lr_0 = 3.7726e-04
Validation auc = 0.734261
Epoch 188
Loss = 1.0932e-01, PNorm = 67.0000, GNorm = 2.1631, lr_0 = 3.7861e-04
Validation auc = 0.712343
Epoch 189
Loss = 1.5333e-01, PNorm = 67.0324, GNorm = 1.8655, lr_0 = 3.7996e-04
Loss = 6.5448e-02, PNorm = 67.0617, GNorm = 1.6029, lr_0 = 3.8130e-04
Validation auc = 0.724889
Epoch 190
Loss = 1.4400e-01, PNorm = 67.0830, GNorm = 4.0682, lr_0 = 3.8265e-04
Validation auc = 0.721966
Epoch 191
Loss = 8.7756e-02, PNorm = 67.1194, GNorm = 3.5311, lr_0 = 3.8399e-04
Validation auc = 0.726487
Epoch 192
Loss = 1.3584e-01, PNorm = 67.1504, GNorm = 2.5493, lr_0 = 3.8534e-04
Validation auc = 0.739926
Epoch 193
Loss = 1.1019e-01, PNorm = 67.1815, GNorm = 0.9123, lr_0 = 3.8668e-04
Validation auc = 0.729330
Epoch 194
Loss = 1.8992e-01, PNorm = 67.2159, GNorm = 2.7670, lr_0 = 3.8803e-04
Validation auc = 0.720906
Epoch 195
Loss = 1.1725e-01, PNorm = 67.2506, GNorm = 1.9217, lr_0 = 3.8937e-04
Validation auc = 0.728960
Epoch 196
Loss = 9.3643e-02, PNorm = 67.2868, GNorm = 1.7996, lr_0 = 3.9072e-04
Validation auc = 0.742330
Epoch 197
Loss = 7.2917e-02, PNorm = 67.3196, GNorm = 1.8679, lr_0 = 3.9206e-04
Validation auc = 0.727150
Epoch 198
Loss = 1.2964e-01, PNorm = 67.3526, GNorm = 3.2609, lr_0 = 3.9341e-04
Validation auc = 0.739195
Epoch 199
Loss = 1.7360e-01, PNorm = 67.3778, GNorm = 2.2822, lr_0 = 3.9475e-04
Loss = 1.1677e-01, PNorm = 67.4156, GNorm = 2.4313, lr_0 = 3.9610e-04
Validation auc = 0.728754
Epoch 200
Loss = 1.0246e-01, PNorm = 67.4462, GNorm = 1.3366, lr_0 = 3.9744e-04
Validation auc = 0.746079
Epoch 201
Loss = 1.5651e-01, PNorm = 67.4851, GNorm = 4.5787, lr_0 = 3.9879e-04
Validation auc = 0.726786
Epoch 202
Loss = 1.4414e-01, PNorm = 67.5222, GNorm = 3.0556, lr_0 = 4.0013e-04
Validation auc = 0.709621
Epoch 203
Loss = 1.4832e-01, PNorm = 67.5552, GNorm = 1.9642, lr_0 = 4.0148e-04
Validation auc = 0.728679
Epoch 204
Loss = 1.3017e-01, PNorm = 67.5927, GNorm = 2.3292, lr_0 = 4.0283e-04
Validation auc = 0.728155
Epoch 205
Loss = 1.0152e-01, PNorm = 67.6271, GNorm = 1.6463, lr_0 = 4.0417e-04
Validation auc = 0.705800
Epoch 206
Loss = 8.9912e-02, PNorm = 67.6580, GNorm = 1.9966, lr_0 = 4.0552e-04
Validation auc = 0.727088
Epoch 207
Loss = 7.6121e-02, PNorm = 67.6874, GNorm = 5.7498, lr_0 = 4.0686e-04
Validation auc = 0.696667
Epoch 208
Loss = 2.2028e-01, PNorm = 67.7179, GNorm = 3.5359, lr_0 = 4.0821e-04
Validation auc = 0.728124
Epoch 209
Loss = 1.2892e-01, PNorm = 67.7444, GNorm = 2.0439, lr_0 = 4.0955e-04
Loss = 1.4547e-01, PNorm = 67.7780, GNorm = 2.7658, lr_0 = 4.1090e-04
Validation auc = 0.749843
Epoch 210
Loss = 8.5438e-02, PNorm = 67.8127, GNorm = 2.3440, lr_0 = 4.1224e-04
Validation auc = 0.725232
Epoch 211
Loss = 1.0143e-01, PNorm = 67.8508, GNorm = 1.1631, lr_0 = 4.1359e-04
Validation auc = 0.761282
Epoch 212
Loss = 1.1610e-01, PNorm = 67.8785, GNorm = 1.3219, lr_0 = 4.1493e-04
Validation auc = 0.723476
Epoch 213
Loss = 7.6674e-02, PNorm = 67.9037, GNorm = 3.3015, lr_0 = 4.1628e-04
Validation auc = 0.723557
Epoch 214
Loss = 4.4807e-02, PNorm = 67.9328, GNorm = 1.1761, lr_0 = 4.1762e-04
Validation auc = 0.710194
Epoch 215
Loss = 4.8219e-02, PNorm = 67.9629, GNorm = 2.8396, lr_0 = 4.1897e-04
Validation auc = 0.720431
Epoch 216
Loss = 1.2286e-01, PNorm = 67.9961, GNorm = 5.3938, lr_0 = 4.2031e-04
Validation auc = 0.747394
Epoch 217
Loss = 8.2781e-02, PNorm = 68.0206, GNorm = 2.2803, lr_0 = 4.2166e-04
Validation auc = 0.683960
Epoch 218
Loss = 9.8580e-02, PNorm = 68.0553, GNorm = 2.4933, lr_0 = 4.2300e-04
Validation auc = 0.725426
Epoch 219
Loss = 1.3021e-01, PNorm = 68.0950, GNorm = 2.6746, lr_0 = 4.2435e-04
Loss = 1.1481e-01, PNorm = 68.1363, GNorm = 4.4591, lr_0 = 4.2570e-04
Validation auc = 0.721614
Epoch 220
Loss = 1.2894e-01, PNorm = 68.1739, GNorm = 2.9380, lr_0 = 4.2704e-04
Validation auc = 0.727875
Epoch 221
Loss = 8.6044e-02, PNorm = 68.2102, GNorm = 1.1286, lr_0 = 4.2839e-04
Validation auc = 0.741419
Epoch 222
Loss = 1.0199e-01, PNorm = 68.2434, GNorm = 2.7246, lr_0 = 4.2973e-04
Validation auc = 0.726813
Epoch 223
Loss = 9.2402e-02, PNorm = 68.2678, GNorm = 2.6570, lr_0 = 4.3108e-04
Validation auc = 0.714953
Epoch 224
Loss = 3.1286e-02, PNorm = 68.2976, GNorm = 2.0698, lr_0 = 4.3242e-04
Validation auc = 0.731571
Epoch 225
Loss = 1.0528e-01, PNorm = 68.3267, GNorm = 3.4811, lr_0 = 4.3377e-04
Validation auc = 0.725399
Epoch 226
Loss = 8.9835e-02, PNorm = 68.3573, GNorm = 1.4957, lr_0 = 4.3511e-04
Validation auc = 0.728035
Epoch 227
Loss = 5.8542e-02, PNorm = 68.3941, GNorm = 1.5897, lr_0 = 4.3646e-04
Validation auc = 0.719873
Epoch 228
Loss = 7.2080e-02, PNorm = 68.4221, GNorm = 0.7505, lr_0 = 4.3780e-04
Validation auc = 0.727200
Epoch 229
Loss = 4.6995e-02, PNorm = 68.4534, GNorm = 1.9285, lr_0 = 4.3915e-04
Loss = 8.9029e-02, PNorm = 68.4867, GNorm = 3.2680, lr_0 = 4.4049e-04
Validation auc = 0.742237
Epoch 230
Loss = 9.0721e-02, PNorm = 68.5137, GNorm = 2.3643, lr_0 = 4.4184e-04
Validation auc = 0.730680
Epoch 231
Loss = 9.0099e-02, PNorm = 68.5463, GNorm = 3.7662, lr_0 = 4.4318e-04
Validation auc = 0.732186
Epoch 232
Loss = 1.0365e-01, PNorm = 68.5867, GNorm = 6.9060, lr_0 = 4.4453e-04
Validation auc = 0.755262
Epoch 233
Loss = 1.6008e-01, PNorm = 68.6353, GNorm = 1.9890, lr_0 = 4.4587e-04
Validation auc = 0.738869
Epoch 234
Loss = 1.2396e-01, PNorm = 68.6943, GNorm = 2.6979, lr_0 = 4.4722e-04
Validation auc = 0.739802
Epoch 235
Loss = 3.3497e-02, PNorm = 68.7464, GNorm = 0.7803, lr_0 = 4.4857e-04
Validation auc = 0.727265
Epoch 236
Loss = 1.4730e-01, PNorm = 68.7867, GNorm = 3.7338, lr_0 = 4.4991e-04
Validation auc = 0.724188
Epoch 237
Loss = 1.1672e-01, PNorm = 68.8189, GNorm = 6.0499, lr_0 = 4.5126e-04
Validation auc = 0.701000
Epoch 238
Loss = 1.8380e-01, PNorm = 68.8496, GNorm = 1.7055, lr_0 = 4.5260e-04
Validation auc = 0.697257
Epoch 239
Loss = 6.1026e-02, PNorm = 68.8863, GNorm = 1.0835, lr_0 = 4.5395e-04
Loss = 1.4350e-01, PNorm = 68.9230, GNorm = 1.9110, lr_0 = 4.5529e-04
Validation auc = 0.709837
Epoch 240
Loss = 7.7816e-02, PNorm = 68.9652, GNorm = 4.2964, lr_0 = 4.5664e-04
Validation auc = 0.724600
Epoch 241
Loss = 9.7622e-02, PNorm = 69.0075, GNorm = 3.7621, lr_0 = 4.5798e-04
Validation auc = 0.708012
Epoch 242
Loss = 8.0576e-02, PNorm = 69.0510, GNorm = 0.9022, lr_0 = 4.5933e-04
Validation auc = 0.738339
Epoch 243
Loss = 5.0308e-02, PNorm = 69.0863, GNorm = 1.4238, lr_0 = 4.6067e-04
Validation auc = 0.734349
Epoch 244
Loss = 7.0967e-02, PNorm = 69.1171, GNorm = 1.0266, lr_0 = 4.6202e-04
Validation auc = 0.718482
Epoch 245
Loss = 1.3597e-01, PNorm = 69.1411, GNorm = 1.8240, lr_0 = 4.6336e-04
Validation auc = 0.722446
Epoch 246
Loss = 5.9356e-02, PNorm = 69.1684, GNorm = 0.4662, lr_0 = 4.6471e-04
Validation auc = 0.730192
Epoch 247
Loss = 6.4057e-02, PNorm = 69.2056, GNorm = 0.9519, lr_0 = 4.6605e-04
Validation auc = 0.726306
Epoch 248
Loss = 4.1655e-02, PNorm = 69.2473, GNorm = 2.5272, lr_0 = 4.6740e-04
Validation auc = 0.733358
Epoch 249
Loss = 3.6977e-02, PNorm = 69.2809, GNorm = 1.5721, lr_0 = 4.6874e-04
Loss = 1.4571e-01, PNorm = 69.3058, GNorm = 4.7424, lr_0 = 4.7009e-04
Validation auc = 0.737867
Epoch 250
Loss = 7.2693e-02, PNorm = 69.3355, GNorm = 2.4690, lr_0 = 4.7143e-04
Validation auc = 0.740719
Epoch 251
Loss = 6.6826e-02, PNorm = 69.3774, GNorm = 2.0139, lr_0 = 4.7278e-04
Validation auc = 0.748845
Epoch 252
Loss = 7.5467e-02, PNorm = 69.4130, GNorm = 0.2447, lr_0 = 4.7413e-04
Validation auc = 0.709490
Epoch 253
Loss = 8.0921e-02, PNorm = 69.4480, GNorm = 2.5577, lr_0 = 4.7547e-04
Validation auc = 0.756094
Epoch 254
Loss = 1.5375e-01, PNorm = 69.4816, GNorm = 3.1839, lr_0 = 4.7682e-04
Validation auc = 0.739694
Epoch 255
Loss = 8.0327e-02, PNorm = 69.5069, GNorm = 1.2399, lr_0 = 4.7816e-04
Validation auc = 0.733074
Epoch 256
Loss = 9.6079e-02, PNorm = 69.5409, GNorm = 2.2154, lr_0 = 4.7951e-04
Validation auc = 0.709737
Epoch 257
Loss = 1.2898e-01, PNorm = 69.5763, GNorm = 5.3157, lr_0 = 4.8085e-04
Validation auc = 0.741680
Epoch 258
Loss = 5.6683e-02, PNorm = 69.6130, GNorm = 0.6958, lr_0 = 4.8220e-04
Validation auc = 0.716967
Epoch 259
Loss = 1.0648e-01, PNorm = 69.6480, GNorm = 1.1048, lr_0 = 4.8354e-04
Loss = 1.0713e-01, PNorm = 69.6738, GNorm = 1.5449, lr_0 = 4.8489e-04
Validation auc = 0.735307
Epoch 260
Loss = 1.1817e-01, PNorm = 69.6994, GNorm = 3.5047, lr_0 = 4.8623e-04
Validation auc = 0.739944
Epoch 261
Loss = 6.1221e-02, PNorm = 69.7361, GNorm = 0.6626, lr_0 = 4.8758e-04
Validation auc = 0.708176
Epoch 262
Loss = 1.1086e-01, PNorm = 69.7734, GNorm = 4.7859, lr_0 = 4.8892e-04
Validation auc = 0.731968
Epoch 263
Loss = 1.3742e-01, PNorm = 69.8059, GNorm = 1.1644, lr_0 = 4.9027e-04
Validation auc = 0.717008
Epoch 264
Loss = 5.5875e-02, PNorm = 69.8360, GNorm = 0.4179, lr_0 = 4.9161e-04
Validation auc = 0.721120
Epoch 265
Loss = 6.5511e-02, PNorm = 69.8678, GNorm = 2.6309, lr_0 = 4.9296e-04
Validation auc = 0.718089
Epoch 266
Loss = 1.7238e-01, PNorm = 69.8931, GNorm = 1.1506, lr_0 = 4.9430e-04
Validation auc = 0.731356
Epoch 267
Loss = 4.5866e-02, PNorm = 69.9297, GNorm = 0.2844, lr_0 = 4.9565e-04
Validation auc = 0.723293
Epoch 268
Loss = 3.4340e-02, PNorm = 69.9750, GNorm = 1.2571, lr_0 = 4.9700e-04
Validation auc = 0.713138
Epoch 269
Loss = 4.1577e-02, PNorm = 70.0234, GNorm = 3.0181, lr_0 = 4.9834e-04
Loss = 1.2564e-01, PNorm = 70.0625, GNorm = 4.0947, lr_0 = 4.9969e-04
Validation auc = 0.689819
Epoch 270
Loss = 1.0541e-01, PNorm = 70.0854, GNorm = 1.2670, lr_0 = 5.0103e-04
Validation auc = 0.717759
Epoch 271
Loss = 1.2058e-01, PNorm = 70.1276, GNorm = 2.6436, lr_0 = 5.0238e-04
Validation auc = 0.691922
Epoch 272
Loss = 8.8387e-02, PNorm = 70.1713, GNorm = 1.6118, lr_0 = 5.0372e-04
Validation auc = 0.738666
Epoch 273
Loss = 6.8400e-02, PNorm = 70.2274, GNorm = 0.9800, lr_0 = 5.0507e-04
Validation auc = 0.733568
Epoch 274
Loss = 8.4374e-02, PNorm = 70.2649, GNorm = 1.1013, lr_0 = 5.0641e-04
Validation auc = 0.742919
Epoch 275
Loss = 6.1666e-02, PNorm = 70.3048, GNorm = 1.4913, lr_0 = 5.0776e-04
Validation auc = 0.730586
Epoch 276
Loss = 4.6795e-02, PNorm = 70.3554, GNorm = 2.0040, lr_0 = 5.0910e-04
Validation auc = 0.742655
Epoch 277
Loss = 6.1861e-02, PNorm = 70.4001, GNorm = 4.8812, lr_0 = 5.1045e-04
Validation auc = 0.730755
Epoch 278
Loss = 6.9641e-02, PNorm = 70.4314, GNorm = 3.4324, lr_0 = 5.1179e-04
Validation auc = 0.719699
Epoch 279
Loss = 2.7984e-02, PNorm = 70.4680, GNorm = 1.0314, lr_0 = 5.1314e-04
Loss = 1.1628e-01, PNorm = 70.5064, GNorm = 0.3443, lr_0 = 5.1448e-04
Validation auc = 0.722864
Epoch 280
Loss = 1.1544e-01, PNorm = 70.5485, GNorm = 3.8011, lr_0 = 5.1583e-04
Validation auc = 0.719666
Epoch 281
Loss = 1.1836e-01, PNorm = 70.5981, GNorm = 2.6494, lr_0 = 5.1717e-04
Validation auc = 0.731321
Epoch 282
Loss = 1.0528e-01, PNorm = 70.6435, GNorm = 4.2671, lr_0 = 5.1852e-04
Validation auc = 0.718333
Epoch 283
Loss = 9.2582e-02, PNorm = 70.6933, GNorm = 0.4675, lr_0 = 5.1987e-04
Validation auc = 0.716641
Epoch 284
Loss = 9.2914e-02, PNorm = 70.7421, GNorm = 0.3268, lr_0 = 5.2121e-04
Validation auc = 0.725734
Epoch 285
Loss = 1.0032e-01, PNorm = 70.7890, GNorm = 1.2317, lr_0 = 5.2256e-04
Validation auc = 0.723584
Epoch 286
Loss = 7.2016e-02, PNorm = 70.8187, GNorm = 1.9978, lr_0 = 5.2390e-04
Validation auc = 0.728748
Epoch 287
Loss = 6.7812e-02, PNorm = 70.8579, GNorm = 2.3749, lr_0 = 5.2525e-04
Validation auc = 0.697586
Epoch 288
Loss = 1.5637e-01, PNorm = 70.9056, GNorm = 1.9614, lr_0 = 5.2659e-04
Validation auc = 0.742067
Epoch 289
Loss = 4.4296e-02, PNorm = 70.9613, GNorm = 1.1938, lr_0 = 5.2794e-04
Loss = 1.1110e-01, PNorm = 71.0304, GNorm = 1.5293, lr_0 = 5.2928e-04
Validation auc = 0.736751
Epoch 290
Loss = 6.5346e-02, PNorm = 71.0860, GNorm = 1.6496, lr_0 = 5.3063e-04
Validation auc = 0.741185
Epoch 291
Loss = 1.0643e-01, PNorm = 71.1331, GNorm = 7.1993, lr_0 = 5.3197e-04
Validation auc = 0.746154
Epoch 292
Loss = 8.7030e-02, PNorm = 71.1789, GNorm = 2.8758, lr_0 = 5.3332e-04
Validation auc = 0.732193
Epoch 293
Loss = 7.3843e-02, PNorm = 71.2207, GNorm = 1.5827, lr_0 = 5.3466e-04
Validation auc = 0.718770
Epoch 294
Loss = 6.8163e-02, PNorm = 71.2650, GNorm = 0.3029, lr_0 = 5.3601e-04
Validation auc = 0.748801
Epoch 295
Loss = 2.9182e-02, PNorm = 71.3086, GNorm = 0.4330, lr_0 = 5.3735e-04
Validation auc = 0.743308
Epoch 296
Loss = 1.2754e-01, PNorm = 71.3412, GNorm = 1.9420, lr_0 = 5.3870e-04
Validation auc = 0.741701
Epoch 297
Loss = 3.2191e-02, PNorm = 71.3618, GNorm = 0.8316, lr_0 = 5.4004e-04
Validation auc = 0.727086
Epoch 298
Loss = 8.7855e-02, PNorm = 71.4026, GNorm = 2.1417, lr_0 = 5.4139e-04
Validation auc = 0.724715
Epoch 299
Loss = 5.8798e-02, PNorm = 71.4501, GNorm = 1.8898, lr_0 = 5.4274e-04
Loss = 1.0577e-01, PNorm = 71.4997, GNorm = 1.3849, lr_0 = 5.4408e-04
Validation auc = 0.734085
Epoch 300
Loss = 7.7880e-02, PNorm = 71.5485, GNorm = 2.9111, lr_0 = 5.4543e-04
Validation auc = 0.741238
Epoch 301
Loss = 7.4390e-02, PNorm = 71.5880, GNorm = 1.6337, lr_0 = 5.4677e-04
Validation auc = 0.737219
Epoch 302
Loss = 9.2614e-02, PNorm = 71.6308, GNorm = 2.3700, lr_0 = 5.4812e-04
Validation auc = 0.739723
Epoch 303
Loss = 1.0216e-01, PNorm = 71.6740, GNorm = 1.4278, lr_0 = 5.4946e-04
Validation auc = 0.737773
Epoch 304
Loss = 7.2280e-02, PNorm = 71.7145, GNorm = 1.1596, lr_0 = 5.5081e-04
Validation auc = 0.744830
Epoch 305
Loss = 4.6401e-02, PNorm = 71.7632, GNorm = 1.0442, lr_0 = 5.5215e-04
Validation auc = 0.724527
Epoch 306
Loss = 7.2645e-02, PNorm = 71.8125, GNorm = 1.4330, lr_0 = 5.5350e-04
Validation auc = 0.737846
Epoch 307
Loss = 3.6606e-02, PNorm = 71.8753, GNorm = 2.7181, lr_0 = 5.5484e-04
Validation auc = 0.709201
Epoch 308
Loss = 5.6698e-02, PNorm = 71.9503, GNorm = 1.6175, lr_0 = 5.5619e-04
Validation auc = 0.717442
Epoch 309
Loss = 7.2561e-02, PNorm = 72.0095, GNorm = 1.9676, lr_0 = 5.5753e-04
Loss = 7.0983e-02, PNorm = 72.0669, GNorm = 2.6175, lr_0 = 5.5888e-04
Validation auc = 0.740902
Epoch 310
Loss = 4.5763e-02, PNorm = 72.1179, GNorm = 2.0238, lr_0 = 5.6022e-04
Validation auc = 0.716990
Epoch 311
Loss = 7.3639e-02, PNorm = 72.1513, GNorm = 1.4366, lr_0 = 5.6157e-04
Validation auc = 0.731101
Epoch 312
Loss = 7.7539e-02, PNorm = 72.1806, GNorm = 3.2508, lr_0 = 5.6291e-04
Validation auc = 0.737314
Epoch 313
Loss = 6.9043e-02, PNorm = 72.2228, GNorm = 2.1243, lr_0 = 5.6426e-04
Validation auc = 0.745815
Epoch 314
Loss = 2.8945e-02, PNorm = 72.2735, GNorm = 0.5324, lr_0 = 5.6561e-04
Validation auc = 0.734125
Epoch 315
Loss = 8.4389e-02, PNorm = 72.3182, GNorm = 1.6927, lr_0 = 5.6695e-04
Validation auc = 0.748221
Epoch 316
Loss = 6.4864e-02, PNorm = 72.3565, GNorm = 1.6904, lr_0 = 5.6830e-04
Validation auc = 0.726512
Epoch 317
Loss = 5.6641e-02, PNorm = 72.4035, GNorm = 2.1214, lr_0 = 5.6964e-04
Validation auc = 0.742776
Epoch 318
Loss = 6.8057e-02, PNorm = 72.4564, GNorm = 0.5190, lr_0 = 5.7099e-04
Validation auc = 0.744041
Epoch 319
Loss = 3.2688e-02, PNorm = 72.5121, GNorm = 1.2604, lr_0 = 5.7233e-04
Loss = 8.7318e-02, PNorm = 72.5734, GNorm = 2.8941, lr_0 = 5.7368e-04
Validation auc = 0.723300
Epoch 320
Loss = 7.0028e-02, PNorm = 72.6308, GNorm = 1.4090, lr_0 = 5.7502e-04
Validation auc = 0.756278
Epoch 321
Loss = 5.6033e-02, PNorm = 72.6784, GNorm = 0.8112, lr_0 = 5.7637e-04
Validation auc = 0.753672
Epoch 322
Loss = 4.0490e-02, PNorm = 72.7277, GNorm = 1.1223, lr_0 = 5.7771e-04
Validation auc = 0.758418
Epoch 323
Loss = 6.7004e-02, PNorm = 72.7635, GNorm = 1.1865, lr_0 = 5.7906e-04
Validation auc = 0.740942
Epoch 324
Loss = 1.0477e-01, PNorm = 72.8035, GNorm = 0.8609, lr_0 = 5.8040e-04
Validation auc = 0.718972
Epoch 325
Loss = 1.0233e-01, PNorm = 72.8450, GNorm = 0.7138, lr_0 = 5.8175e-04
Validation auc = 0.712644
Epoch 326
Loss = 3.2856e-02, PNorm = 72.9066, GNorm = 1.5212, lr_0 = 5.8309e-04
Validation auc = 0.721102
Epoch 327
Loss = 5.1283e-02, PNorm = 72.9600, GNorm = 2.1108, lr_0 = 5.8444e-04
Validation auc = 0.737881
Epoch 328
Loss = 5.8544e-02, PNorm = 72.9995, GNorm = 2.1587, lr_0 = 5.8578e-04
Validation auc = 0.763742
Epoch 329
Loss = 8.7200e-02, PNorm = 73.0343, GNorm = 1.1067, lr_0 = 5.8713e-04
Loss = 5.9537e-02, PNorm = 73.0692, GNorm = 1.5388, lr_0 = 5.8848e-04
Validation auc = 0.754125
Epoch 330
Loss = 4.7801e-02, PNorm = 73.1095, GNorm = 1.1023, lr_0 = 5.8982e-04
Validation auc = 0.743653
Epoch 331
Loss = 7.1207e-02, PNorm = 73.1360, GNorm = 2.3700, lr_0 = 5.9117e-04
Validation auc = 0.747036
Epoch 332
Loss = 9.2900e-02, PNorm = 73.1534, GNorm = 2.1340, lr_0 = 5.9251e-04
Validation auc = 0.737424
Epoch 333
Loss = 4.5883e-02, PNorm = 73.1891, GNorm = 0.9625, lr_0 = 5.9386e-04
Validation auc = 0.715867
Epoch 334
Loss = 5.7343e-02, PNorm = 73.2344, GNorm = 1.0386, lr_0 = 5.9520e-04
Validation auc = 0.757473
Epoch 335
Loss = 8.0964e-02, PNorm = 73.2841, GNorm = 1.6946, lr_0 = 5.9655e-04
Validation auc = 0.753511
Epoch 336
Loss = 6.4106e-02, PNorm = 73.3333, GNorm = 1.0358, lr_0 = 5.9789e-04
Validation auc = 0.747108
Epoch 337
Loss = 8.7313e-02, PNorm = 73.3771, GNorm = 2.2634, lr_0 = 5.9924e-04
Validation auc = 0.747973
Epoch 338
Loss = 7.7351e-02, PNorm = 73.4221, GNorm = 0.2161, lr_0 = 6.0058e-04
Validation auc = 0.732014
Epoch 339
Loss = 1.5487e-01, PNorm = 73.4596, GNorm = 2.2633, lr_0 = 6.0193e-04
Loss = 7.6878e-02, PNorm = 73.5039, GNorm = 1.4287, lr_0 = 6.0327e-04
Validation auc = 0.717698
Epoch 340
Loss = 8.5656e-02, PNorm = 73.5548, GNorm = 1.3933, lr_0 = 6.0462e-04
Validation auc = 0.737265
Epoch 341
Loss = 3.9653e-02, PNorm = 73.6093, GNorm = 0.6069, lr_0 = 6.0596e-04
Validation auc = 0.725291
Epoch 342
Loss = 8.8238e-02, PNorm = 73.6610, GNorm = 2.1706, lr_0 = 6.0731e-04
Validation auc = 0.743850
Epoch 343
Loss = 1.1706e-01, PNorm = 73.6985, GNorm = 2.0283, lr_0 = 6.0865e-04
Validation auc = 0.732491
Epoch 344
Loss = 1.1059e-01, PNorm = 73.7621, GNorm = 2.0207, lr_0 = 6.1000e-04
Validation auc = 0.720393
Epoch 345
Loss = 8.5685e-02, PNorm = 73.8453, GNorm = 1.6112, lr_0 = 6.1135e-04
Validation auc = 0.733468
Epoch 346
Loss = 5.0483e-02, PNorm = 73.9119, GNorm = 1.2422, lr_0 = 6.1269e-04
Validation auc = 0.739444
Epoch 347
Loss = 1.3304e-01, PNorm = 73.9571, GNorm = 1.0799, lr_0 = 6.1404e-04
Validation auc = 0.721439
Epoch 348
Loss = 7.9804e-02, PNorm = 74.0192, GNorm = 1.5271, lr_0 = 6.1538e-04
Validation auc = 0.741834
Epoch 349
Loss = 4.7630e-02, PNorm = 74.0790, GNorm = 1.6250, lr_0 = 6.1673e-04
Loss = 3.9019e-02, PNorm = 74.1416, GNorm = 2.7970, lr_0 = 6.1807e-04
Validation auc = 0.739497
Epoch 350
Loss = 4.9524e-02, PNorm = 74.2038, GNorm = 2.6849, lr_0 = 6.1942e-04
Validation auc = 0.714953
Epoch 351
Loss = 1.4524e-01, PNorm = 74.2515, GNorm = 1.3675, lr_0 = 6.2076e-04
Validation auc = 0.719855
Epoch 352
Loss = 8.8476e-02, PNorm = 74.3148, GNorm = 1.6997, lr_0 = 6.2211e-04
Validation auc = 0.700030
Epoch 353
Loss = 7.6935e-02, PNorm = 74.3816, GNorm = 1.3761, lr_0 = 6.2345e-04
Validation auc = 0.721961
Epoch 354
Loss = 4.9071e-02, PNorm = 74.4525, GNorm = 2.3179, lr_0 = 6.2480e-04
Validation auc = 0.732810
Epoch 355
Loss = 3.3516e-02, PNorm = 74.5188, GNorm = 0.5189, lr_0 = 6.2614e-04
Validation auc = 0.740365
Epoch 356
Loss = 6.1662e-02, PNorm = 74.5746, GNorm = 1.5042, lr_0 = 6.2749e-04
Validation auc = 0.738085
Epoch 357
Loss = 5.5073e-02, PNorm = 74.6366, GNorm = 1.3507, lr_0 = 6.2883e-04
Validation auc = 0.754315
Epoch 358
Loss = 5.1344e-02, PNorm = 74.6929, GNorm = 1.9191, lr_0 = 6.3018e-04
Validation auc = 0.734829
Epoch 359
Loss = 2.4558e-02, PNorm = 74.7362, GNorm = 0.6810, lr_0 = 6.3152e-04
Loss = 6.1775e-02, PNorm = 74.7783, GNorm = 1.0284, lr_0 = 6.3287e-04
Validation auc = 0.735911
Epoch 360
Loss = 5.6186e-02, PNorm = 74.8310, GNorm = 1.6540, lr_0 = 6.3422e-04
Validation auc = 0.749435
Epoch 361
Loss = 8.5938e-02, PNorm = 74.8822, GNorm = 1.2513, lr_0 = 6.3556e-04
Validation auc = 0.736360
Epoch 362
Loss = 5.4864e-02, PNorm = 74.9401, GNorm = 2.5844, lr_0 = 6.3691e-04
Validation auc = 0.733520
Epoch 363
Loss = 6.6103e-02, PNorm = 75.0047, GNorm = 2.8358, lr_0 = 6.3825e-04
Validation auc = 0.735813
Epoch 364
Loss = 7.0617e-02, PNorm = 75.0676, GNorm = 1.6876, lr_0 = 6.3960e-04
Validation auc = 0.735983
Epoch 365
Loss = 5.8474e-02, PNorm = 75.1223, GNorm = 1.8131, lr_0 = 6.4094e-04
Validation auc = 0.733680
Epoch 366
Loss = 7.9099e-02, PNorm = 75.1889, GNorm = 1.1676, lr_0 = 6.4229e-04
Validation auc = 0.753807
Epoch 367
Loss = 6.6925e-02, PNorm = 75.2538, GNorm = 3.9976, lr_0 = 6.4363e-04
Validation auc = 0.724694
Epoch 368
Loss = 6.3636e-02, PNorm = 75.3057, GNorm = 1.8083, lr_0 = 6.4498e-04
Validation auc = 0.695997
Epoch 369
Loss = 8.0824e-02, PNorm = 75.3625, GNorm = 2.5529, lr_0 = 6.4632e-04
Loss = 4.6326e-02, PNorm = 75.4199, GNorm = 0.1362, lr_0 = 6.4767e-04
Validation auc = 0.726219
Epoch 370
Loss = 4.8832e-02, PNorm = 75.4675, GNorm = 0.8933, lr_0 = 6.4901e-04
Validation auc = 0.724413
Epoch 371
Loss = 9.4810e-02, PNorm = 75.5138, GNorm = 0.4786, lr_0 = 6.5036e-04
Validation auc = 0.737386
Epoch 372
Loss = 9.8345e-02, PNorm = 75.5711, GNorm = 1.5822, lr_0 = 6.5170e-04
Validation auc = 0.731819
Epoch 373
Loss = 1.0263e-01, PNorm = 75.6179, GNorm = 1.1005, lr_0 = 6.5305e-04
Validation auc = 0.736394
Epoch 374
Loss = 7.7322e-02, PNorm = 75.6715, GNorm = 2.2403, lr_0 = 6.5439e-04
Validation auc = 0.724935
Epoch 375
Loss = 7.2115e-02, PNorm = 75.7304, GNorm = 0.7019, lr_0 = 6.5574e-04
Validation auc = 0.736212
Epoch 376
Loss = 3.5293e-02, PNorm = 75.7886, GNorm = 1.2858, lr_0 = 6.5709e-04
Validation auc = 0.729699
Epoch 377
Loss = 1.2587e-02, PNorm = 75.8496, GNorm = 0.6442, lr_0 = 6.5843e-04
Validation auc = 0.739431
Epoch 378
Loss = 2.1749e-02, PNorm = 75.9057, GNorm = 1.6268, lr_0 = 6.5978e-04
Validation auc = 0.720260
Epoch 379
Loss = 5.7110e-02, PNorm = 75.9724, GNorm = 2.3625, lr_0 = 6.6112e-04
Loss = 3.3567e-02, PNorm = 76.0334, GNorm = 0.4265, lr_0 = 6.6247e-04
Validation auc = 0.722011
Epoch 380
Loss = 7.3182e-02, PNorm = 76.0835, GNorm = 0.7147, lr_0 = 6.6381e-04
Validation auc = 0.761533
Epoch 381
Loss = 6.3881e-02, PNorm = 76.1194, GNorm = 0.2582, lr_0 = 6.6516e-04
Validation auc = 0.755193
Epoch 382
Loss = 6.6839e-02, PNorm = 76.1813, GNorm = 2.0968, lr_0 = 6.6650e-04
Validation auc = 0.733787
Epoch 383
Loss = 8.4843e-02, PNorm = 76.2438, GNorm = 0.9456, lr_0 = 6.6785e-04
Validation auc = 0.749908
Epoch 384
Loss = 9.4314e-02, PNorm = 76.2992, GNorm = 1.0046, lr_0 = 6.6919e-04
Validation auc = 0.738894
Epoch 385
Loss = 2.5356e-02, PNorm = 76.3642, GNorm = 0.4838, lr_0 = 6.7054e-04
Validation auc = 0.725921
Epoch 386
Loss = 6.3789e-02, PNorm = 76.4220, GNorm = 1.3770, lr_0 = 6.7188e-04
Validation auc = 0.719234
Epoch 387
Loss = 1.1016e-01, PNorm = 76.4701, GNorm = 0.9652, lr_0 = 6.7323e-04
Validation auc = 0.710519
Epoch 388
Loss = 7.6810e-02, PNorm = 76.5189, GNorm = 1.0714, lr_0 = 6.7457e-04
Validation auc = 0.739334
Epoch 389
Loss = 1.3108e-01, PNorm = 76.5982, GNorm = 1.6206, lr_0 = 6.7592e-04
Loss = 4.8550e-02, PNorm = 76.6919, GNorm = 1.1890, lr_0 = 6.7726e-04
Validation auc = 0.727044
Epoch 390
Loss = 5.1107e-02, PNorm = 76.7693, GNorm = 0.4581, lr_0 = 6.7861e-04
Validation auc = 0.744291
Epoch 391
Loss = 5.6986e-02, PNorm = 76.8389, GNorm = 1.1861, lr_0 = 6.7996e-04
Validation auc = 0.737143
Epoch 392
Loss = 6.3444e-02, PNorm = 76.8874, GNorm = 3.3277, lr_0 = 6.8130e-04
Validation auc = 0.727357
Epoch 393
Loss = 6.6570e-02, PNorm = 76.9493, GNorm = 0.9627, lr_0 = 6.8265e-04
Validation auc = 0.716631
Epoch 394
Loss = 3.4830e-02, PNorm = 77.0346, GNorm = 0.4758, lr_0 = 6.8399e-04
Validation auc = 0.699837
Epoch 395
Loss = 6.7209e-02, PNorm = 77.1078, GNorm = 1.9228, lr_0 = 6.8534e-04
Validation auc = 0.691537
Epoch 396
Loss = 4.3884e-02, PNorm = 77.1595, GNorm = 1.6046, lr_0 = 6.8668e-04
Validation auc = 0.718124
Epoch 397
Loss = 1.0332e-01, PNorm = 77.2110, GNorm = 0.0925, lr_0 = 6.8803e-04
Validation auc = 0.726062
Epoch 398
Loss = 7.0787e-02, PNorm = 77.2620, GNorm = 1.8094, lr_0 = 6.8937e-04
Validation auc = 0.722311
Epoch 399
Loss = 1.5854e-01, PNorm = 77.3288, GNorm = 3.0076, lr_0 = 6.9072e-04
Loss = 8.3980e-02, PNorm = 77.4265, GNorm = 2.2105, lr_0 = 6.9206e-04
Validation auc = 0.728051
Epoch 400
Loss = 9.7234e-02, PNorm = 77.5135, GNorm = 2.0446, lr_0 = 6.9341e-04
Validation auc = 0.699536
Epoch 401
Loss = 7.4534e-02, PNorm = 77.6120, GNorm = 2.4088, lr_0 = 6.9475e-04
Validation auc = 0.720788
Epoch 402
Loss = 6.5828e-02, PNorm = 77.7104, GNorm = 1.5098, lr_0 = 6.9610e-04
Validation auc = 0.728052
Epoch 403
Loss = 4.2576e-02, PNorm = 77.7987, GNorm = 1.8395, lr_0 = 6.9744e-04
Validation auc = 0.736730
Epoch 404
Loss = 1.4351e-01, PNorm = 77.8768, GNorm = 6.2987, lr_0 = 6.9879e-04
Validation auc = 0.739609
Epoch 405
Loss = 1.0498e-01, PNorm = 77.9919, GNorm = 2.8410, lr_0 = 7.0013e-04
Validation auc = 0.739890
Epoch 406
Loss = 6.8444e-02, PNorm = 78.0932, GNorm = 1.9323, lr_0 = 7.0148e-04
Validation auc = 0.724073
Epoch 407
Loss = 7.6671e-02, PNorm = 78.1838, GNorm = 1.7846, lr_0 = 7.0283e-04
Validation auc = 0.742877
Epoch 408
Loss = 1.5770e-01, PNorm = 78.2535, GNorm = 1.9388, lr_0 = 7.0417e-04
Validation auc = 0.750629
Epoch 409
Loss = 5.0934e-02, PNorm = 78.3357, GNorm = 1.7150, lr_0 = 7.0552e-04
Loss = 7.0366e-02, PNorm = 78.4381, GNorm = 2.6722, lr_0 = 7.0686e-04
Validation auc = 0.731580
Epoch 410
Loss = 5.5042e-02, PNorm = 78.5163, GNorm = 1.6823, lr_0 = 7.0821e-04
Validation auc = 0.726399
Epoch 411
Loss = 8.0129e-02, PNorm = 78.5789, GNorm = 1.9116, lr_0 = 7.0955e-04
Validation auc = 0.717978
Epoch 412
Loss = 8.6509e-02, PNorm = 78.6323, GNorm = 1.6043, lr_0 = 7.1090e-04
Validation auc = 0.694706
Epoch 413
Loss = 7.5059e-02, PNorm = 78.6902, GNorm = 0.5973, lr_0 = 7.1224e-04
Validation auc = 0.745061
Epoch 414
Loss = 6.8229e-02, PNorm = 78.7578, GNorm = 1.2183, lr_0 = 7.1359e-04
Validation auc = 0.729414
Epoch 415
Loss = 1.0475e-01, PNorm = 78.8361, GNorm = 2.8050, lr_0 = 7.1493e-04
Validation auc = 0.717981
Epoch 416
Loss = 1.9980e-02, PNorm = 78.9074, GNorm = 0.4310, lr_0 = 7.1628e-04
Validation auc = 0.701878
Epoch 417
Loss = 6.4008e-02, PNorm = 78.9749, GNorm = 2.6425, lr_0 = 7.1762e-04
Validation auc = 0.719423
Epoch 418
Loss = 3.8518e-02, PNorm = 79.0425, GNorm = 2.3417, lr_0 = 7.1897e-04
Validation auc = 0.727988
Epoch 419
Loss = 6.3089e-02, PNorm = 79.1157, GNorm = 1.8892, lr_0 = 7.2031e-04
Loss = 8.4470e-02, PNorm = 79.1890, GNorm = 0.7349, lr_0 = 7.2166e-04
Validation auc = 0.716413
Epoch 420
Loss = 7.3923e-02, PNorm = 79.2568, GNorm = 0.5874, lr_0 = 7.2300e-04
Validation auc = 0.734264
Epoch 421
Loss = 3.4442e-02, PNorm = 79.3217, GNorm = 0.9442, lr_0 = 7.2435e-04
Validation auc = 0.728165
Epoch 422
Loss = 4.2190e-02, PNorm = 79.3912, GNorm = 1.5235, lr_0 = 7.2570e-04
Validation auc = 0.732339
Epoch 423
Loss = 3.3728e-02, PNorm = 79.4499, GNorm = 1.0299, lr_0 = 7.2704e-04
Validation auc = 0.748846
Epoch 424
Loss = 8.9653e-02, PNorm = 79.5104, GNorm = 2.6386, lr_0 = 7.2839e-04
Validation auc = 0.733277
Epoch 425
Loss = 3.8935e-02, PNorm = 79.5713, GNorm = 2.7845, lr_0 = 7.2973e-04
Validation auc = 0.712323
Epoch 426
Loss = 2.2506e-01, PNorm = 79.6280, GNorm = 2.0527, lr_0 = 7.3108e-04
Validation auc = 0.726082
Epoch 427
Loss = 7.9665e-02, PNorm = 79.7368, GNorm = 2.2056, lr_0 = 7.3242e-04
Validation auc = 0.738435
Epoch 428
Loss = 5.8349e-02, PNorm = 79.8349, GNorm = 0.8532, lr_0 = 7.3377e-04
Validation auc = 0.737369
Epoch 429
Loss = 1.5966e-02, PNorm = 79.9070, GNorm = 0.4752, lr_0 = 7.3511e-04
Loss = 6.3808e-02, PNorm = 79.9623, GNorm = 1.2128, lr_0 = 7.3646e-04
Validation auc = 0.718751
Epoch 430
Loss = 6.4200e-02, PNorm = 80.0190, GNorm = 3.0178, lr_0 = 7.3780e-04
Validation auc = 0.725076
Epoch 431
Loss = 4.8250e-02, PNorm = 80.0920, GNorm = 1.8333, lr_0 = 7.3915e-04
Validation auc = 0.714097
Epoch 432
Loss = 4.3301e-02, PNorm = 80.1731, GNorm = 1.5386, lr_0 = 7.4049e-04
Validation auc = 0.724875
Epoch 433
Loss = 1.0254e-01, PNorm = 80.2350, GNorm = 1.1424, lr_0 = 7.4184e-04
Validation auc = 0.719114
Epoch 434
Loss = 7.6105e-02, PNorm = 80.3059, GNorm = 1.7540, lr_0 = 7.4318e-04
Validation auc = 0.709111
Epoch 435
Loss = 7.0419e-02, PNorm = 80.3686, GNorm = 0.4406, lr_0 = 7.4453e-04
Validation auc = 0.697146
Epoch 436
Loss = 7.8449e-02, PNorm = 80.4411, GNorm = 1.8669, lr_0 = 7.4587e-04
Validation auc = 0.726723
Epoch 437
Loss = 3.9947e-02, PNorm = 80.5150, GNorm = 1.0172, lr_0 = 7.4722e-04
Validation auc = 0.741948
Epoch 438
Loss = 3.7794e-02, PNorm = 80.5760, GNorm = 0.1313, lr_0 = 7.4857e-04
Validation auc = 0.707128
Epoch 439
Loss = 2.9681e-03, PNorm = 80.6485, GNorm = 0.0675, lr_0 = 7.4991e-04
Loss = 1.1540e-01, PNorm = 80.7025, GNorm = 0.6754, lr_0 = 7.5126e-04
Validation auc = 0.716074
Epoch 440
Loss = 5.9896e-02, PNorm = 80.7789, GNorm = 0.5057, lr_0 = 7.5260e-04
Validation auc = 0.737863
Epoch 441
Loss = 5.1987e-02, PNorm = 80.8595, GNorm = 1.2342, lr_0 = 7.5395e-04
Validation auc = 0.731195
Epoch 442
Loss = 5.3430e-02, PNorm = 80.9402, GNorm = 0.2532, lr_0 = 7.5529e-04
Validation auc = 0.703494
Epoch 443
Loss = 4.6033e-02, PNorm = 81.0137, GNorm = 0.9742, lr_0 = 7.5664e-04
Validation auc = 0.729222
Epoch 444
Loss = 5.3863e-02, PNorm = 81.0887, GNorm = 1.2064, lr_0 = 7.5798e-04
Validation auc = 0.731977
Epoch 445
Loss = 6.9034e-02, PNorm = 81.1707, GNorm = 0.7880, lr_0 = 7.5933e-04
Validation auc = 0.722361
Epoch 446
Loss = 4.1308e-02, PNorm = 81.2526, GNorm = 1.8507, lr_0 = 7.6067e-04
Validation auc = 0.721866
Epoch 447
Loss = 6.4812e-02, PNorm = 81.3269, GNorm = 1.0981, lr_0 = 7.6202e-04
Validation auc = 0.734676
Epoch 448
Loss = 1.2862e-01, PNorm = 81.3814, GNorm = 1.6437, lr_0 = 7.6336e-04
Validation auc = 0.732480
Epoch 449
Loss = 3.0099e-01, PNorm = 81.4393, GNorm = 2.6696, lr_0 = 7.6471e-04
Loss = 7.0088e-02, PNorm = 81.5006, GNorm = 1.9615, lr_0 = 7.6605e-04
Validation auc = 0.729368
Epoch 450
Loss = 4.7164e-02, PNorm = 81.5747, GNorm = 1.6048, lr_0 = 7.6740e-04
Validation auc = 0.725084
Epoch 451
Loss = 2.6097e-02, PNorm = 81.6421, GNorm = 0.2415, lr_0 = 7.6874e-04
Validation auc = 0.739547
Epoch 452
Loss = 5.8799e-02, PNorm = 81.7009, GNorm = 2.8243, lr_0 = 7.7009e-04
Validation auc = 0.739782
Epoch 453
Loss = 4.7434e-02, PNorm = 81.7618, GNorm = 1.1987, lr_0 = 7.7143e-04
Validation auc = 0.730094
Epoch 454
Loss = 1.0430e-01, PNorm = 81.8159, GNorm = 0.7632, lr_0 = 7.7278e-04
Validation auc = 0.719206
Epoch 455
Loss = 2.9654e-02, PNorm = 81.8676, GNorm = 0.7106, lr_0 = 7.7413e-04
Validation auc = 0.721797
Epoch 456
Loss = 2.9521e-02, PNorm = 81.9380, GNorm = 1.4168, lr_0 = 7.7547e-04
Validation auc = 0.718415
Epoch 457
Loss = 3.5081e-02, PNorm = 81.9980, GNorm = 1.5218, lr_0 = 7.7682e-04
Validation auc = 0.731510
Epoch 458
Loss = 6.8509e-02, PNorm = 82.0515, GNorm = 0.2912, lr_0 = 7.7816e-04
Validation auc = 0.735257
Epoch 459
Loss = 1.6368e-02, PNorm = 82.1070, GNorm = 0.8222, lr_0 = 7.7951e-04
Loss = 4.1883e-02, PNorm = 82.1610, GNorm = 0.8064, lr_0 = 7.8085e-04
Validation auc = 0.714497
Epoch 460
Loss = 4.7407e-02, PNorm = 82.1944, GNorm = 0.2188, lr_0 = 7.8220e-04
Validation auc = 0.712555
Epoch 461
Loss = 2.1920e-02, PNorm = 82.2521, GNorm = 1.1967, lr_0 = 7.8354e-04
Validation auc = 0.719367
Epoch 462
Loss = 6.8466e-02, PNorm = 82.2945, GNorm = 0.1957, lr_0 = 7.8489e-04
Validation auc = 0.731308
Epoch 463
Loss = 7.2790e-02, PNorm = 82.3406, GNorm = 1.9342, lr_0 = 7.8623e-04
Validation auc = 0.739869
Epoch 464
Loss = 7.7883e-02, PNorm = 82.4052, GNorm = 2.5575, lr_0 = 7.8758e-04
Validation auc = 0.721439
Epoch 465
Loss = 8.4884e-02, PNorm = 82.4955, GNorm = 1.5166, lr_0 = 7.8892e-04
Validation auc = 0.734111
Epoch 466
Loss = 4.4595e-02, PNorm = 82.6212, GNorm = 1.5747, lr_0 = 7.9027e-04
Validation auc = 0.705791
Epoch 467
Loss = 4.9822e-02, PNorm = 82.7290, GNorm = 2.0341, lr_0 = 7.9161e-04
Validation auc = 0.720834
Epoch 468
Loss = 2.8668e-02, PNorm = 82.8157, GNorm = 1.5470, lr_0 = 7.9296e-04
Validation auc = 0.735563
Epoch 469
Loss = 1.3287e-01, PNorm = 82.9000, GNorm = 1.6253, lr_0 = 7.9430e-04
Loss = 6.4557e-02, PNorm = 82.9919, GNorm = 1.7505, lr_0 = 7.9565e-04
Validation auc = 0.735016
Epoch 470
Loss = 6.5386e-02, PNorm = 83.0829, GNorm = 0.6981, lr_0 = 7.9700e-04
Validation auc = 0.745517
Epoch 471
Loss = 5.4846e-02, PNorm = 83.1926, GNorm = 2.8359, lr_0 = 7.9834e-04
Validation auc = 0.729966
Epoch 472
Loss = 8.7602e-02, PNorm = 83.2793, GNorm = 2.3457, lr_0 = 7.9969e-04
Validation auc = 0.715787
Epoch 473
Loss = 7.5768e-02, PNorm = 83.3562, GNorm = 0.9503, lr_0 = 8.0103e-04
Validation auc = 0.730585
Epoch 474
Loss = 7.3693e-02, PNorm = 83.4457, GNorm = 1.1859, lr_0 = 8.0238e-04
Validation auc = 0.727543
Epoch 475
Loss = 3.4281e-02, PNorm = 83.5204, GNorm = 1.1966, lr_0 = 8.0372e-04
Validation auc = 0.726033
Epoch 476
Loss = 3.3147e-02, PNorm = 83.5940, GNorm = 1.3886, lr_0 = 8.0507e-04
Validation auc = 0.740676
Epoch 477
Loss = 2.6174e-02, PNorm = 83.6640, GNorm = 1.4833, lr_0 = 8.0641e-04
Validation auc = 0.747438
Epoch 478
Loss = 4.2453e-02, PNorm = 83.7477, GNorm = 0.9784, lr_0 = 8.0776e-04
Validation auc = 0.737145
Epoch 479
Loss = 1.4610e-01, PNorm = 83.8177, GNorm = 1.1263, lr_0 = 8.0910e-04
Loss = 5.2409e-02, PNorm = 83.9058, GNorm = 2.2476, lr_0 = 8.1045e-04
Validation auc = 0.723010
Epoch 480
Loss = 8.0997e-02, PNorm = 83.9712, GNorm = 0.7979, lr_0 = 8.1179e-04
Validation auc = 0.733885
Epoch 481
Loss = 4.8048e-02, PNorm = 84.0267, GNorm = 0.4505, lr_0 = 8.1314e-04
Validation auc = 0.740717
Epoch 482
Loss = 3.4539e-02, PNorm = 84.1079, GNorm = 2.8950, lr_0 = 8.1448e-04
Validation auc = 0.753690
Epoch 483
Loss = 2.9610e-02, PNorm = 84.1930, GNorm = 0.0500, lr_0 = 8.1583e-04
Validation auc = 0.758499
Epoch 484
Loss = 1.1557e-01, PNorm = 84.2503, GNorm = 2.1489, lr_0 = 8.1717e-04
Validation auc = 0.720660
Epoch 485
Loss = 4.5418e-02, PNorm = 84.3210, GNorm = 0.8094, lr_0 = 8.1852e-04
Validation auc = 0.713469
Epoch 486
Loss = 9.9740e-02, PNorm = 84.4126, GNorm = 1.9817, lr_0 = 8.1987e-04
Validation auc = 0.734346
Epoch 487
Loss = 6.9477e-02, PNorm = 84.5483, GNorm = 0.6933, lr_0 = 8.2121e-04
Validation auc = 0.739110
Epoch 488
Loss = 8.2057e-02, PNorm = 84.6874, GNorm = 0.6821, lr_0 = 8.2256e-04
Validation auc = 0.737898
Epoch 489
Loss = 1.2481e-02, PNorm = 84.7880, GNorm = 0.6018, lr_0 = 8.2390e-04
Loss = 7.1214e-02, PNorm = 84.8634, GNorm = 0.4321, lr_0 = 8.2525e-04
Validation auc = 0.742925
Epoch 490
Loss = 3.6389e-02, PNorm = 84.9499, GNorm = 1.0361, lr_0 = 8.2659e-04
Validation auc = 0.744030
Epoch 491
Loss = 3.4502e-02, PNorm = 85.0219, GNorm = 0.0457, lr_0 = 8.2794e-04
Validation auc = 0.746172
Epoch 492
Loss = 8.5906e-02, PNorm = 85.0944, GNorm = 2.7819, lr_0 = 8.2928e-04
Validation auc = 0.742856
Epoch 493
Loss = 8.7991e-02, PNorm = 85.1826, GNorm = 0.2066, lr_0 = 8.3063e-04
Validation auc = 0.721844
Epoch 494
Loss = 6.2322e-02, PNorm = 85.2794, GNorm = 1.1225, lr_0 = 8.3197e-04
Validation auc = 0.719456
Epoch 495
Loss = 4.4532e-02, PNorm = 85.3869, GNorm = 1.3885, lr_0 = 8.3332e-04
Validation auc = 0.719874
Epoch 496
Loss = 1.6844e-02, PNorm = 85.4850, GNorm = 0.7766, lr_0 = 8.3466e-04
Validation auc = 0.761272
Epoch 497
Loss = 4.9783e-02, PNorm = 85.5689, GNorm = 2.1875, lr_0 = 8.3601e-04
Validation auc = 0.727618
Epoch 498
Loss = 6.7270e-02, PNorm = 85.6772, GNorm = 1.5493, lr_0 = 8.3735e-04
Validation auc = 0.720383
Epoch 499
Loss = 1.3016e-01, PNorm = 85.8191, GNorm = 1.0750, lr_0 = 8.3870e-04
Loss = 6.1267e-02, PNorm = 85.9473, GNorm = 0.7087, lr_0 = 8.4004e-04
Validation auc = 0.731894
Epoch 500
Loss = 4.7181e-02, PNorm = 86.0449, GNorm = 1.0291, lr_0 = 8.4139e-04
Validation auc = 0.737873
Epoch 501
Loss = 2.8997e-02, PNorm = 86.1105, GNorm = 0.1298, lr_0 = 8.4274e-04
Validation auc = 0.735556
Epoch 502
Loss = 5.2410e-02, PNorm = 86.1796, GNorm = 0.8881, lr_0 = 8.4408e-04
Validation auc = 0.727622
Epoch 503
Loss = 6.1161e-02, PNorm = 86.2359, GNorm = 1.2693, lr_0 = 8.4543e-04
Validation auc = 0.720360
Epoch 504
Loss = 6.1198e-02, PNorm = 86.3087, GNorm = 1.0021, lr_0 = 8.4677e-04
Validation auc = 0.724126
Epoch 505
Loss = 8.0062e-03, PNorm = 86.3699, GNorm = 0.8567, lr_0 = 8.4812e-04
Validation auc = 0.738285
Epoch 506
Loss = 7.0860e-02, PNorm = 86.4290, GNorm = 1.0120, lr_0 = 8.4946e-04
Validation auc = 0.685952
Epoch 507
Loss = 5.0802e-02, PNorm = 86.5214, GNorm = 1.0485, lr_0 = 8.5081e-04
Validation auc = 0.702874
Epoch 508
Loss = 8.8683e-03, PNorm = 86.6128, GNorm = 0.1047, lr_0 = 8.5215e-04
Validation auc = 0.722398
Epoch 509
Loss = 8.6236e-03, PNorm = 86.6927, GNorm = 0.4070, lr_0 = 8.5350e-04
Loss = 6.0942e-02, PNorm = 86.7750, GNorm = 2.3088, lr_0 = 8.5484e-04
Validation auc = 0.714118
Epoch 510
Loss = 6.9519e-02, PNorm = 86.8401, GNorm = 1.9278, lr_0 = 8.5619e-04
Validation auc = 0.719676
Epoch 511
Loss = 1.0151e-01, PNorm = 86.9058, GNorm = 1.7065, lr_0 = 8.5753e-04
Validation auc = 0.700367
Epoch 512
Loss = 9.3538e-02, PNorm = 87.0231, GNorm = 1.3411, lr_0 = 8.5888e-04
Validation auc = 0.695901
Epoch 513
Loss = 9.8345e-02, PNorm = 87.1328, GNorm = 2.2017, lr_0 = 8.6022e-04
Validation auc = 0.703322
Epoch 514
Loss = 4.3738e-02, PNorm = 87.2444, GNorm = 2.1929, lr_0 = 8.6157e-04
Validation auc = 0.699140
Epoch 515
Loss = 5.5984e-02, PNorm = 87.3448, GNorm = 0.4979, lr_0 = 8.6291e-04
Validation auc = 0.698140
Epoch 516
Loss = 7.3804e-02, PNorm = 87.4390, GNorm = 0.9805, lr_0 = 8.6426e-04
Validation auc = 0.698547
Epoch 517
Loss = 1.9996e-02, PNorm = 87.5269, GNorm = 0.8537, lr_0 = 8.6561e-04
Validation auc = 0.689266
Epoch 518
Loss = 1.2677e-01, PNorm = 87.6232, GNorm = 1.8471, lr_0 = 8.6695e-04
Validation auc = 0.674666
Epoch 519
Loss = 2.6328e-02, PNorm = 87.7208, GNorm = 1.1147, lr_0 = 8.6830e-04
Loss = 8.4132e-02, PNorm = 87.8107, GNorm = 2.9266, lr_0 = 8.6964e-04
Validation auc = 0.725031
Epoch 520
Loss = 6.0250e-02, PNorm = 87.8963, GNorm = 1.1419, lr_0 = 8.7099e-04
Validation auc = 0.715730
Epoch 521
Loss = 3.7854e-02, PNorm = 88.0090, GNorm = 3.8228, lr_0 = 8.7233e-04
Validation auc = 0.718581
Epoch 522
Loss = 6.4319e-02, PNorm = 88.1097, GNorm = 0.4914, lr_0 = 8.7368e-04
Validation auc = 0.729370
Epoch 523
Loss = 1.0915e-01, PNorm = 88.2095, GNorm = 1.2489, lr_0 = 8.7502e-04
Validation auc = 0.719390
Epoch 524
Loss = 1.0610e-01, PNorm = 88.3339, GNorm = 1.1699, lr_0 = 8.7637e-04
Validation auc = 0.710356
Epoch 525
Loss = 4.5053e-02, PNorm = 88.4458, GNorm = 1.5175, lr_0 = 8.7771e-04
Validation auc = 0.701565
Epoch 526
Loss = 3.5201e-02, PNorm = 88.5427, GNorm = 1.0374, lr_0 = 8.7906e-04
Validation auc = 0.698869
Epoch 527
Loss = 1.4342e-02, PNorm = 88.6279, GNorm = 0.1966, lr_0 = 8.8040e-04
Validation auc = 0.703676
Epoch 528
Loss = 6.8455e-02, PNorm = 88.7215, GNorm = 2.9250, lr_0 = 8.8175e-04
Validation auc = 0.709253
Epoch 529
Loss = 8.4043e-02, PNorm = 88.8146, GNorm = 2.8750, lr_0 = 8.8309e-04
Loss = 5.8660e-02, PNorm = 88.9007, GNorm = 0.8804, lr_0 = 8.8444e-04
Validation auc = 0.705732
Epoch 530
Loss = 4.9812e-02, PNorm = 89.0038, GNorm = 1.2474, lr_0 = 8.8578e-04
Validation auc = 0.710519
Epoch 531
Loss = 1.0401e-01, PNorm = 89.0891, GNorm = 2.1512, lr_0 = 8.8713e-04
Validation auc = 0.727479
Epoch 532
Loss = 6.2972e-02, PNorm = 89.2015, GNorm = 2.3449, lr_0 = 8.8848e-04
Validation auc = 0.729248
Epoch 533
Loss = 4.0448e-02, PNorm = 89.3171, GNorm = 0.5795, lr_0 = 8.8982e-04
Validation auc = 0.724143
Epoch 534
Loss = 1.0439e-01, PNorm = 89.4063, GNorm = 2.5426, lr_0 = 8.9117e-04
Validation auc = 0.710039
Epoch 535
Loss = 6.3757e-02, PNorm = 89.4808, GNorm = 0.4672, lr_0 = 8.9251e-04
Validation auc = 0.668067
Epoch 536
Loss = 7.7930e-02, PNorm = 89.5756, GNorm = 2.0062, lr_0 = 8.9386e-04
Validation auc = 0.687923
Epoch 537
Loss = 4.0793e-02, PNorm = 89.6937, GNorm = 0.9345, lr_0 = 8.9520e-04
Validation auc = 0.703591
Epoch 538
Loss = 1.4818e-02, PNorm = 89.7939, GNorm = 0.6600, lr_0 = 8.9655e-04
Validation auc = 0.700892
Epoch 539
Loss = 2.0696e-02, PNorm = 89.8580, GNorm = 0.8731, lr_0 = 8.9789e-04
Loss = 5.3463e-02, PNorm = 89.9383, GNorm = 0.6018, lr_0 = 8.9924e-04
Validation auc = 0.708876
Epoch 540
Loss = 3.9452e-02, PNorm = 90.0246, GNorm = 0.8989, lr_0 = 9.0058e-04
Validation auc = 0.721655
Epoch 541
Loss = 3.8821e-02, PNorm = 90.0997, GNorm = 1.3938, lr_0 = 9.0193e-04
Validation auc = 0.713747
Epoch 542
Loss = 4.3753e-02, PNorm = 90.1837, GNorm = 1.5025, lr_0 = 9.0327e-04
Validation auc = 0.718317
Epoch 543
Loss = 3.1859e-02, PNorm = 90.2513, GNorm = 2.7193, lr_0 = 9.0462e-04
Validation auc = 0.718674
Epoch 544
Loss = 7.5852e-02, PNorm = 90.3224, GNorm = 0.0333, lr_0 = 9.0596e-04
Validation auc = 0.708891
Epoch 545
Loss = 4.7990e-02, PNorm = 90.4205, GNorm = 2.1387, lr_0 = 9.0731e-04
Validation auc = 0.702238
Epoch 546
Loss = 5.1914e-02, PNorm = 90.5242, GNorm = 1.2303, lr_0 = 9.0865e-04
Validation auc = 0.699286
Epoch 547
Loss = 3.4556e-02, PNorm = 90.6194, GNorm = 1.0643, lr_0 = 9.1000e-04
Validation auc = 0.701138
Epoch 548
Loss = 1.0360e-01, PNorm = 90.7062, GNorm = 1.8766, lr_0 = 9.1135e-04
Validation auc = 0.716778
Epoch 549
Loss = 1.4895e-02, PNorm = 90.7936, GNorm = 0.9672, lr_0 = 9.1269e-04
Loss = 3.5782e-02, PNorm = 90.8637, GNorm = 0.1869, lr_0 = 9.1404e-04
Validation auc = 0.726003
Epoch 550
Loss = 4.1511e-02, PNorm = 90.9115, GNorm = 1.4530, lr_0 = 9.1538e-04
Validation auc = 0.730472
Epoch 551
Loss = 7.7204e-02, PNorm = 90.9891, GNorm = 0.7928, lr_0 = 9.1673e-04
Validation auc = 0.724361
Epoch 552
Loss = 5.0871e-02, PNorm = 91.1157, GNorm = 1.0533, lr_0 = 9.1807e-04
Validation auc = 0.726382
Epoch 553
Loss = 8.3184e-02, PNorm = 91.2395, GNorm = 2.4402, lr_0 = 9.1942e-04
Validation auc = 0.731874
Epoch 554
Loss = 1.8880e-02, PNorm = 91.3667, GNorm = 1.9076, lr_0 = 9.2076e-04
Validation auc = 0.718539
Epoch 555
Loss = 4.2048e-02, PNorm = 91.4839, GNorm = 0.0732, lr_0 = 9.2211e-04
Validation auc = 0.711922
Epoch 556
Loss = 2.5276e-02, PNorm = 91.5990, GNorm = 1.1851, lr_0 = 9.2345e-04
Validation auc = 0.719564
Epoch 557
Loss = 8.6639e-02, PNorm = 91.7072, GNorm = 2.1973, lr_0 = 9.2480e-04
Validation auc = 0.735966
Epoch 558
Loss = 2.5082e-02, PNorm = 91.8238, GNorm = 0.6217, lr_0 = 9.2614e-04
Validation auc = 0.720935
Epoch 559
Loss = 7.2556e-02, PNorm = 91.9762, GNorm = 0.8708, lr_0 = 9.2749e-04
Loss = 5.4818e-02, PNorm = 92.1411, GNorm = 2.1386, lr_0 = 9.2883e-04
Validation auc = 0.689208
Epoch 560
Loss = 5.1193e-02, PNorm = 92.2678, GNorm = 0.4780, lr_0 = 9.3018e-04
Validation auc = 0.699951
Epoch 561
Loss = 2.4318e-02, PNorm = 92.3670, GNorm = 0.4923, lr_0 = 9.3152e-04
Validation auc = 0.712913
Epoch 562
Loss = 5.1968e-02, PNorm = 92.4492, GNorm = 3.0936, lr_0 = 9.3287e-04
Validation auc = 0.706863
Epoch 563
Loss = 8.3716e-02, PNorm = 92.5525, GNorm = 1.5981, lr_0 = 9.3422e-04
Validation auc = 0.706811
Epoch 564
Loss = 7.5797e-02, PNorm = 92.6491, GNorm = 0.8939, lr_0 = 9.3556e-04
Validation auc = 0.698125
Epoch 565
Loss = 4.9744e-02, PNorm = 92.7800, GNorm = 0.5335, lr_0 = 9.3691e-04
Validation auc = 0.712496
Epoch 566
Loss = 2.8042e-02, PNorm = 92.8942, GNorm = 0.3973, lr_0 = 9.3825e-04
Validation auc = 0.700029
Epoch 567
Loss = 1.0729e-01, PNorm = 92.9871, GNorm = 0.3266, lr_0 = 9.3960e-04
Validation auc = 0.706798
Epoch 568
Loss = 5.6179e-02, PNorm = 93.0785, GNorm = 1.0723, lr_0 = 9.4094e-04
Validation auc = 0.712335
Epoch 569
Loss = 3.9718e-02, PNorm = 93.2692, GNorm = 1.0052, lr_0 = 9.4229e-04
Loss = 4.0009e-02, PNorm = 93.4497, GNorm = 0.6142, lr_0 = 9.4363e-04
Validation auc = 0.734800
Epoch 570
Loss = 9.3310e-02, PNorm = 93.5983, GNorm = 1.9823, lr_0 = 9.4498e-04
Validation auc = 0.719400
Epoch 571
Loss = 5.2201e-02, PNorm = 93.7318, GNorm = 1.3525, lr_0 = 9.4632e-04
Validation auc = 0.731553
Epoch 572
Loss = 1.2731e-01, PNorm = 93.8350, GNorm = 1.0988, lr_0 = 9.4767e-04
Validation auc = 0.750846
Epoch 573
Loss = 9.4849e-02, PNorm = 93.9435, GNorm = 1.1694, lr_0 = 9.4901e-04
Validation auc = 0.718024
Epoch 574
Loss = 5.6594e-02, PNorm = 94.0500, GNorm = 0.8542, lr_0 = 9.5036e-04
Validation auc = 0.698872
Epoch 575
Loss = 5.4538e-02, PNorm = 94.1759, GNorm = 2.0600, lr_0 = 9.5170e-04
Validation auc = 0.722501
Epoch 576
Loss = 8.9119e-02, PNorm = 94.2858, GNorm = 0.0778, lr_0 = 9.5305e-04
Validation auc = 0.737229
Epoch 577
Loss = 4.7270e-02, PNorm = 94.3951, GNorm = 0.2722, lr_0 = 9.5439e-04
Validation auc = 0.738976
Epoch 578
Loss = 1.1871e-01, PNorm = 94.5009, GNorm = 1.0587, lr_0 = 9.5574e-04
Validation auc = 0.733238
Epoch 579
Loss = 6.1111e-02, PNorm = 94.6174, GNorm = 0.8052, lr_0 = 9.5709e-04
Loss = 5.5277e-02, PNorm = 94.7303, GNorm = 1.4890, lr_0 = 9.5843e-04
Validation auc = 0.732470
Epoch 580
Loss = 9.0577e-02, PNorm = 94.8214, GNorm = 0.2588, lr_0 = 9.5978e-04
Validation auc = 0.727279
Epoch 581
Loss = 7.0739e-02, PNorm = 94.9297, GNorm = 1.5823, lr_0 = 9.6112e-04
Validation auc = 0.724809
Epoch 582
Loss = 4.1761e-02, PNorm = 95.0464, GNorm = 1.4820, lr_0 = 9.6247e-04
Validation auc = 0.721133
Epoch 583
Loss = 4.6445e-02, PNorm = 95.1492, GNorm = 0.3192, lr_0 = 9.6381e-04
Validation auc = 0.718368
Epoch 584
Loss = 6.2314e-02, PNorm = 95.2262, GNorm = 0.2437, lr_0 = 9.6516e-04
Validation auc = 0.726225
Epoch 585
Loss = 5.4615e-02, PNorm = 95.2961, GNorm = 1.3887, lr_0 = 9.6650e-04
Validation auc = 0.725801
Epoch 586
Loss = 5.8242e-02, PNorm = 95.3793, GNorm = 2.3497, lr_0 = 9.6785e-04
Validation auc = 0.714713
Epoch 587
Loss = 2.6174e-02, PNorm = 95.4777, GNorm = 0.1904, lr_0 = 9.6919e-04
Validation auc = 0.712685
Epoch 588
Loss = 1.6695e-02, PNorm = 95.5826, GNorm = 0.7081, lr_0 = 9.7054e-04
Validation auc = 0.716680
Epoch 589
Loss = 1.8958e-01, PNorm = 95.6837, GNorm = 3.0340, lr_0 = 9.7188e-04
Loss = 6.9897e-02, PNorm = 95.7763, GNorm = 0.1943, lr_0 = 9.7323e-04
Validation auc = 0.730382
Epoch 590
Loss = 8.8637e-02, PNorm = 95.8542, GNorm = 1.4469, lr_0 = 9.7457e-04
Validation auc = 0.726754
Epoch 591
Loss = 4.3977e-02, PNorm = 95.9454, GNorm = 0.2541, lr_0 = 9.7592e-04
Validation auc = 0.731696
Epoch 592
Loss = 6.1539e-02, PNorm = 96.0410, GNorm = 0.7250, lr_0 = 9.7726e-04
Validation auc = 0.739882
Epoch 593
Loss = 2.0614e-02, PNorm = 96.1328, GNorm = 0.3879, lr_0 = 9.7861e-04
Validation auc = 0.731343
Epoch 594
Loss = 6.0219e-02, PNorm = 96.2104, GNorm = 2.2243, lr_0 = 9.7996e-04
Validation auc = 0.724654
Epoch 595
Loss = 3.2451e-02, PNorm = 96.2674, GNorm = 0.4532, lr_0 = 9.8130e-04
Validation auc = 0.723658
Epoch 596
Loss = 1.0165e-01, PNorm = 96.3309, GNorm = 1.5979, lr_0 = 9.8265e-04
Validation auc = 0.739813
Epoch 597
Loss = 3.9992e-02, PNorm = 96.4035, GNorm = 0.5562, lr_0 = 9.8399e-04
Validation auc = 0.735579
Epoch 598
Loss = 8.0740e-02, PNorm = 96.4914, GNorm = 1.1211, lr_0 = 9.8534e-04
Validation auc = 0.717456
Epoch 599
Loss = 3.5572e-02, PNorm = 96.5883, GNorm = 1.4711, lr_0 = 9.8668e-04
Loss = 7.4816e-02, PNorm = 96.7216, GNorm = 2.2813, lr_0 = 9.8803e-04
Validation auc = 0.714906
Epoch 600
Loss = 5.9198e-02, PNorm = 96.8389, GNorm = 0.2576, lr_0 = 9.8937e-04
Validation auc = 0.711298
Epoch 601
Loss = 6.1598e-02, PNorm = 96.9618, GNorm = 0.1626, lr_0 = 9.9072e-04
Validation auc = 0.720567
Epoch 602
Loss = 4.4429e-02, PNorm = 97.0717, GNorm = 2.2836, lr_0 = 9.9206e-04
Validation auc = 0.722362
Epoch 603
Loss = 4.1915e-02, PNorm = 97.1562, GNorm = 1.6264, lr_0 = 9.9341e-04
Validation auc = 0.740181
Epoch 604
Loss = 3.6870e-02, PNorm = 97.2486, GNorm = 0.0889, lr_0 = 9.9475e-04
Validation auc = 0.722107
Epoch 605
Loss = 4.9533e-02, PNorm = 97.3329, GNorm = 1.1215, lr_0 = 9.9610e-04
Validation auc = 0.731329
Epoch 606
Loss = 2.3641e-02, PNorm = 97.4537, GNorm = 0.8903, lr_0 = 9.9744e-04
Validation auc = 0.735094
Epoch 607
Loss = 3.2174e-02, PNorm = 97.5604, GNorm = 1.9930, lr_0 = 9.9879e-04
Validation auc = 0.735381
Epoch 608
Loss = 1.1209e-01, PNorm = 97.7132, GNorm = 1.9409, lr_0 = 1.0000e-03
Validation auc = 0.730339
Epoch 609
Loss = 1.0900e-01, PNorm = 97.8534, GNorm = 1.7560, lr_0 = 1.0000e-03
Loss = 2.9513e-02, PNorm = 97.9823, GNorm = 1.3608, lr_0 = 1.0000e-03
Validation auc = 0.733034
Epoch 610
Loss = 4.1914e-02, PNorm = 98.0986, GNorm = 1.2609, lr_0 = 1.0000e-03
Validation auc = 0.732377
Epoch 611
Loss = 5.8729e-02, PNorm = 98.1977, GNorm = 0.8027, lr_0 = 1.0000e-03
Validation auc = 0.730862
Epoch 612
Loss = 5.2746e-02, PNorm = 98.3056, GNorm = 0.5313, lr_0 = 1.0000e-03
Validation auc = 0.699388
Epoch 613
Loss = 4.7463e-02, PNorm = 98.4476, GNorm = 1.5781, lr_0 = 1.0000e-03
Validation auc = 0.691171
Epoch 614
Loss = 9.2240e-02, PNorm = 98.5726, GNorm = 1.0136, lr_0 = 1.0000e-03
Validation auc = 0.746369
Epoch 615
Loss = 1.4693e-01, PNorm = 98.7189, GNorm = 0.5440, lr_0 = 9.9999e-04
Validation auc = 0.736191
Epoch 616
Loss = 8.7321e-02, PNorm = 98.9001, GNorm = 0.9971, lr_0 = 9.9999e-04
Validation auc = 0.718756
Epoch 617
Loss = 4.3591e-02, PNorm = 99.0576, GNorm = 0.4757, lr_0 = 9.9999e-04
Validation auc = 0.752713
Epoch 618
Loss = 6.3708e-03, PNorm = 99.1971, GNorm = 0.0970, lr_0 = 9.9999e-04
Validation auc = 0.753189
Epoch 619
Loss = 5.8388e-02, PNorm = 99.3029, GNorm = 2.0714, lr_0 = 9.9999e-04
Loss = 6.5539e-02, PNorm = 99.4051, GNorm = 0.3017, lr_0 = 9.9999e-04
Validation auc = 0.731262
Epoch 620
Loss = 3.5851e-02, PNorm = 99.5325, GNorm = 0.8218, lr_0 = 9.9999e-04
Validation auc = 0.696047
Epoch 621
Loss = 8.5287e-02, PNorm = 99.6439, GNorm = 1.6652, lr_0 = 9.9999e-04
Validation auc = 0.718059
Epoch 622
Loss = 5.5282e-02, PNorm = 99.7699, GNorm = 0.9752, lr_0 = 9.9999e-04
Validation auc = 0.728333
Epoch 623
Loss = 2.7024e-02, PNorm = 99.8826, GNorm = 0.8805, lr_0 = 9.9999e-04
Validation auc = 0.705366
Epoch 624
Loss = 2.4147e-02, PNorm = 99.9832, GNorm = 0.1628, lr_0 = 9.9999e-04
Validation auc = 0.700131
Epoch 625
Loss = 2.4702e-02, PNorm = 100.0722, GNorm = 0.3123, lr_0 = 9.9999e-04
Validation auc = 0.686562
Epoch 626
Loss = 7.4731e-02, PNorm = 100.1641, GNorm = 0.1712, lr_0 = 9.9999e-04
Validation auc = 0.717290
Epoch 627
Loss = 5.7911e-02, PNorm = 100.2462, GNorm = 0.1303, lr_0 = 9.9999e-04
Validation auc = 0.715483
Epoch 628
Loss = 4.7457e-02, PNorm = 100.3620, GNorm = 2.2119, lr_0 = 9.9998e-04
Validation auc = 0.751299
Epoch 629
Loss = 7.2773e-03, PNorm = 100.4870, GNorm = 0.1267, lr_0 = 9.9998e-04
Loss = 2.0793e-02, PNorm = 100.5833, GNorm = 0.5248, lr_0 = 9.9998e-04
Validation auc = 0.741615
Epoch 630
Loss = 4.7704e-02, PNorm = 100.6542, GNorm = 1.8912, lr_0 = 9.9998e-04
Validation auc = 0.727982
Epoch 631
Loss = 2.6435e-02, PNorm = 100.7239, GNorm = 0.8492, lr_0 = 9.9998e-04
Validation auc = 0.699241
Epoch 632
Loss = 5.7292e-02, PNorm = 100.8138, GNorm = 0.2419, lr_0 = 9.9998e-04
Validation auc = 0.727176
Epoch 633
Loss = 2.2833e-02, PNorm = 100.9291, GNorm = 0.3346, lr_0 = 9.9998e-04
Validation auc = 0.733501
Epoch 634
Loss = 4.2990e-02, PNorm = 101.0354, GNorm = 0.0404, lr_0 = 9.9998e-04
Validation auc = 0.732932
Epoch 635
Loss = 7.7515e-02, PNorm = 101.1527, GNorm = 2.9729, lr_0 = 9.9998e-04
Validation auc = 0.722688
Epoch 636
Loss = 1.0106e-01, PNorm = 101.2817, GNorm = 0.5398, lr_0 = 9.9998e-04
Validation auc = 0.724028
Epoch 637
Loss = 3.1775e-02, PNorm = 101.3916, GNorm = 0.2283, lr_0 = 9.9998e-04
Validation auc = 0.734863
Epoch 638
Loss = 1.0554e-01, PNorm = 101.4936, GNorm = 1.4082, lr_0 = 9.9998e-04
Validation auc = 0.719000
Epoch 639
Loss = 1.2120e-02, PNorm = 101.5953, GNorm = 0.4360, lr_0 = 9.9998e-04
Loss = 3.1626e-02, PNorm = 101.7216, GNorm = 0.8460, lr_0 = 9.9998e-04
Validation auc = 0.704181
Epoch 640
Loss = 4.7568e-02, PNorm = 101.8240, GNorm = 1.4974, lr_0 = 9.9998e-04
Validation auc = 0.711830
Epoch 641
Loss = 2.8235e-02, PNorm = 101.9249, GNorm = 0.6034, lr_0 = 9.9997e-04
Validation auc = 0.725099
Epoch 642
Loss = 4.5967e-02, PNorm = 102.0226, GNorm = 2.2611, lr_0 = 9.9997e-04
Validation auc = 0.717317
Epoch 643
Loss = 6.6364e-02, PNorm = 102.1544, GNorm = 1.7449, lr_0 = 9.9997e-04
Validation auc = 0.708790
Epoch 644
Loss = 6.1324e-02, PNorm = 102.2773, GNorm = 1.0616, lr_0 = 9.9997e-04
Validation auc = 0.709264
Epoch 645
Loss = 4.1712e-02, PNorm = 102.3890, GNorm = 1.5266, lr_0 = 9.9997e-04
Validation auc = 0.712176
Epoch 646
Loss = 4.9642e-02, PNorm = 102.4892, GNorm = 1.2914, lr_0 = 9.9997e-04
Validation auc = 0.705690
Epoch 647
Loss = 7.9644e-02, PNorm = 102.5914, GNorm = 1.8438, lr_0 = 9.9997e-04
Validation auc = 0.699811
Epoch 648
Loss = 5.0963e-02, PNorm = 102.6909, GNorm = 1.6449, lr_0 = 9.9997e-04
Validation auc = 0.701095
Epoch 649
Loss = 1.4346e-02, PNorm = 102.8181, GNorm = 0.5767, lr_0 = 9.9997e-04
Loss = 8.3157e-02, PNorm = 102.9174, GNorm = 1.1322, lr_0 = 9.9997e-04
Validation auc = 0.715520
Epoch 650
Loss = 5.0967e-02, PNorm = 103.0136, GNorm = 1.2792, lr_0 = 9.9997e-04
Validation auc = 0.731216
Epoch 651
Loss = 7.2738e-02, PNorm = 103.1235, GNorm = 0.2037, lr_0 = 9.9997e-04
Validation auc = 0.737489
Epoch 652
Loss = 2.5535e-02, PNorm = 103.2224, GNorm = 0.0662, lr_0 = 9.9997e-04
Validation auc = 0.725399
Epoch 653
Loss = 6.0723e-02, PNorm = 103.2989, GNorm = 2.7386, lr_0 = 9.9997e-04
Validation auc = 0.709218
Epoch 654
Loss = 4.1701e-02, PNorm = 103.3688, GNorm = 0.4165, lr_0 = 9.9996e-04
Validation auc = 0.706251
Epoch 655
Loss = 1.6338e-02, PNorm = 103.4460, GNorm = 0.2218, lr_0 = 9.9996e-04
Validation auc = 0.695419
Epoch 656
Loss = 1.8489e-02, PNorm = 103.5449, GNorm = 1.0905, lr_0 = 9.9996e-04
Validation auc = 0.700144
Epoch 657
Loss = 8.7874e-02, PNorm = 103.6506, GNorm = 2.7462, lr_0 = 9.9996e-04
Validation auc = 0.697933
Epoch 658
Loss = 2.1818e-02, PNorm = 103.7313, GNorm = 0.1613, lr_0 = 9.9996e-04
Validation auc = 0.709796
Epoch 659
Loss = 1.7554e-02, PNorm = 103.8337, GNorm = 0.2619, lr_0 = 9.9996e-04
Loss = 2.5921e-02, PNorm = 103.9340, GNorm = 0.1567, lr_0 = 9.9996e-04
Validation auc = 0.709744
Epoch 660
Loss = 4.4496e-02, PNorm = 104.0301, GNorm = 0.2144, lr_0 = 9.9996e-04
Validation auc = 0.704752
Epoch 661
Loss = 3.0150e-02, PNorm = 104.1322, GNorm = 1.2153, lr_0 = 9.9996e-04
Validation auc = 0.710356
Epoch 662
Loss = 2.9093e-02, PNorm = 104.2334, GNorm = 1.3172, lr_0 = 9.9996e-04
Validation auc = 0.728194
Epoch 663
Loss = 4.4211e-02, PNorm = 104.3245, GNorm = 1.9101, lr_0 = 9.9996e-04
Validation auc = 0.709554
Epoch 664
Loss = 6.4695e-02, PNorm = 104.4420, GNorm = 1.3117, lr_0 = 9.9996e-04
Validation auc = 0.683275
Epoch 665
Loss = 6.8463e-02, PNorm = 104.5824, GNorm = 1.0176, lr_0 = 9.9996e-04
Validation auc = 0.692523
Epoch 666
Loss = 4.1791e-02, PNorm = 104.7342, GNorm = 0.4529, lr_0 = 9.9996e-04
Validation auc = 0.702680
Epoch 667
Loss = 5.1387e-02, PNorm = 104.8458, GNorm = 0.7837, lr_0 = 9.9996e-04
Validation auc = 0.702823
Epoch 668
Loss = 2.5956e-02, PNorm = 104.9221, GNorm = 0.1529, lr_0 = 9.9995e-04
Validation auc = 0.713685
Epoch 669
Loss = 4.5829e-02, PNorm = 105.0036, GNorm = 1.6803, lr_0 = 9.9995e-04
Loss = 4.9514e-02, PNorm = 105.0901, GNorm = 1.0671, lr_0 = 9.9995e-04
Validation auc = 0.703291
Epoch 670
Loss = 6.1940e-02, PNorm = 105.1739, GNorm = 1.9817, lr_0 = 9.9995e-04
Validation auc = 0.700008
Epoch 671
Loss = 5.5391e-02, PNorm = 105.2769, GNorm = 0.5588, lr_0 = 9.9995e-04
Validation auc = 0.704681
Epoch 672
Loss = 2.6975e-02, PNorm = 105.3918, GNorm = 0.1713, lr_0 = 9.9995e-04
Validation auc = 0.707175
Epoch 673
Loss = 3.9942e-02, PNorm = 105.4790, GNorm = 0.0914, lr_0 = 9.9995e-04
Validation auc = 0.694819
Epoch 674
Loss = 5.1969e-02, PNorm = 105.5498, GNorm = 1.7302, lr_0 = 9.9995e-04
Validation auc = 0.711416
Epoch 675
Loss = 1.8843e-02, PNorm = 105.6353, GNorm = 0.0687, lr_0 = 9.9995e-04
Validation auc = 0.716259
Epoch 676
Loss = 5.0087e-02, PNorm = 105.7326, GNorm = 0.5372, lr_0 = 9.9995e-04
Validation auc = 0.690045
Epoch 677
Loss = 5.1374e-02, PNorm = 105.8426, GNorm = 0.2700, lr_0 = 9.9995e-04
Validation auc = 0.690097
Epoch 678
Loss = 4.5069e-02, PNorm = 105.9387, GNorm = 1.0542, lr_0 = 9.9995e-04
Validation auc = 0.705663
Epoch 679
Loss = 5.5948e-03, PNorm = 106.0683, GNorm = 0.1195, lr_0 = 9.9995e-04
Loss = 3.2081e-02, PNorm = 106.1969, GNorm = 0.4454, lr_0 = 9.9995e-04
Validation auc = 0.713820
Epoch 680
Loss = 4.2769e-02, PNorm = 106.2971, GNorm = 0.1149, lr_0 = 9.9994e-04
Validation auc = 0.712920
Epoch 681
Loss = 4.1662e-02, PNorm = 106.3866, GNorm = 0.5301, lr_0 = 9.9994e-04
Validation auc = 0.704546
Epoch 682
Loss = 6.3901e-02, PNorm = 106.4514, GNorm = 0.2597, lr_0 = 9.9994e-04
Validation auc = 0.704497
Epoch 683
Loss = 3.7999e-02, PNorm = 106.5235, GNorm = 0.4464, lr_0 = 9.9994e-04
Validation auc = 0.732376
Epoch 684
Loss = 6.2998e-02, PNorm = 106.6101, GNorm = 2.5074, lr_0 = 9.9994e-04
Validation auc = 0.714284
Epoch 685
Loss = 6.9563e-02, PNorm = 106.7372, GNorm = 2.2203, lr_0 = 9.9994e-04
Validation auc = 0.721969
Epoch 686
Loss = 1.4580e-02, PNorm = 106.8765, GNorm = 0.2214, lr_0 = 9.9994e-04
Validation auc = 0.718546
Epoch 687
Loss = 3.3650e-02, PNorm = 106.9993, GNorm = 0.9740, lr_0 = 9.9994e-04
Validation auc = 0.719266
Epoch 688
Loss = 2.5270e-02, PNorm = 107.1037, GNorm = 1.0295, lr_0 = 9.9994e-04
Validation auc = 0.709116
Epoch 689
Loss = 1.5146e-02, PNorm = 107.1987, GNorm = 0.3815, lr_0 = 9.9994e-04
Loss = 5.1958e-02, PNorm = 107.2766, GNorm = 0.1085, lr_0 = 9.9994e-04
Validation auc = 0.704659
Epoch 690
Loss = 5.2942e-02, PNorm = 107.3770, GNorm = 0.6776, lr_0 = 9.9994e-04
Validation auc = 0.690441
Epoch 691
Loss = 4.4974e-02, PNorm = 107.4709, GNorm = 0.2614, lr_0 = 9.9994e-04
Validation auc = 0.708116
Epoch 692
Loss = 2.7817e-02, PNorm = 107.5667, GNorm = 1.4371, lr_0 = 9.9994e-04
Validation auc = 0.705043
Epoch 693
Loss = 2.1574e-02, PNorm = 107.6413, GNorm = 1.1116, lr_0 = 9.9994e-04
Validation auc = 0.718759
Epoch 694
Loss = 6.2890e-02, PNorm = 107.7544, GNorm = 2.6543, lr_0 = 9.9993e-04
Validation auc = 0.741673
Epoch 695
Loss = 5.0420e-02, PNorm = 107.8658, GNorm = 1.1938, lr_0 = 9.9993e-04
Validation auc = 0.709773
Epoch 696
Loss = 4.4387e-02, PNorm = 108.0009, GNorm = 1.2481, lr_0 = 9.9993e-04
Validation auc = 0.700086
Epoch 697
Loss = 5.3084e-02, PNorm = 108.1387, GNorm = 0.7492, lr_0 = 9.9993e-04
Validation auc = 0.739643
Epoch 698
Loss = 4.5445e-02, PNorm = 108.2860, GNorm = 0.3824, lr_0 = 9.9993e-04
Validation auc = 0.735618
Epoch 699
Loss = 3.6879e-02, PNorm = 108.4144, GNorm = 1.2110, lr_0 = 9.9993e-04
Loss = 3.4033e-02, PNorm = 108.5132, GNorm = 0.6450, lr_0 = 9.9993e-04
Validation auc = 0.741011
Epoch 700
Loss = 5.3977e-02, PNorm = 108.5984, GNorm = 4.7139, lr_0 = 9.9993e-04
Validation auc = 0.723881
Epoch 701
Loss = 2.9767e-02, PNorm = 108.7138, GNorm = 1.1432, lr_0 = 9.9993e-04
Validation auc = 0.718411
Epoch 702
Loss = 1.0798e-01, PNorm = 108.8154, GNorm = 3.9979, lr_0 = 9.9993e-04
Validation auc = 0.727278
Epoch 703
Loss = 7.5317e-02, PNorm = 108.9691, GNorm = 1.1515, lr_0 = 9.9993e-04
Validation auc = 0.712939
Epoch 704
Loss = 9.5418e-02, PNorm = 109.1000, GNorm = 0.4552, lr_0 = 9.9993e-04
Validation auc = 0.707710
Epoch 705
Loss = 3.6769e-02, PNorm = 109.2303, GNorm = 1.4715, lr_0 = 9.9993e-04
Validation auc = 0.710461
Epoch 706
Loss = 1.8799e-02, PNorm = 109.3762, GNorm = 0.9223, lr_0 = 9.9993e-04
Validation auc = 0.708973
Epoch 707
Loss = 5.3889e-02, PNorm = 109.5014, GNorm = 1.0151, lr_0 = 9.9992e-04
Validation auc = 0.716606
Epoch 708
Loss = 1.5189e-01, PNorm = 109.6341, GNorm = 1.9544, lr_0 = 9.9992e-04
Validation auc = 0.698830
Epoch 709
Loss = 4.3735e-02, PNorm = 109.7805, GNorm = 1.0668, lr_0 = 9.9992e-04
Loss = 5.0830e-02, PNorm = 109.9265, GNorm = 0.7366, lr_0 = 9.9992e-04
Validation auc = 0.722065
Epoch 710
Loss = 6.3177e-02, PNorm = 110.0553, GNorm = 0.0828, lr_0 = 9.9992e-04
Validation auc = 0.705717
Epoch 711
Loss = 5.0522e-02, PNorm = 110.1661, GNorm = 0.3365, lr_0 = 9.9992e-04
Validation auc = 0.709664
Epoch 712
Loss = 8.3039e-02, PNorm = 110.2506, GNorm = 0.9717, lr_0 = 9.9992e-04
Validation auc = 0.702825
Epoch 713
Loss = 4.3983e-02, PNorm = 110.3379, GNorm = 2.2628, lr_0 = 9.9992e-04
Validation auc = 0.716558
Epoch 714
Loss = 3.7122e-02, PNorm = 110.4393, GNorm = 0.3939, lr_0 = 9.9992e-04
Validation auc = 0.716691
Epoch 715
Loss = 4.9574e-02, PNorm = 110.5421, GNorm = 1.3101, lr_0 = 9.9992e-04
Validation auc = 0.711378
Epoch 716
Loss = 1.5923e-02, PNorm = 110.6369, GNorm = 0.1199, lr_0 = 9.9992e-04
Validation auc = 0.705879
Epoch 717
Loss = 2.6965e-02, PNorm = 110.7176, GNorm = 0.1807, lr_0 = 9.9992e-04
Validation auc = 0.699926
Epoch 718
Loss = 2.2762e-02, PNorm = 110.8463, GNorm = 1.6834, lr_0 = 9.9992e-04
Validation auc = 0.706428
Epoch 719
Loss = 8.0851e-02, PNorm = 111.0397, GNorm = 2.6475, lr_0 = 9.9992e-04
Loss = 1.2519e-01, PNorm = 111.2252, GNorm = 2.2499, lr_0 = 9.9992e-04
Validation auc = 0.739402
Epoch 720
Loss = 4.8768e-02, PNorm = 111.3894, GNorm = 1.5540, lr_0 = 9.9991e-04
Validation auc = 0.693643
Epoch 721
Loss = 9.0297e-02, PNorm = 111.5234, GNorm = 0.5912, lr_0 = 9.9991e-04
Validation auc = 0.704159
Epoch 722
Loss = 3.7841e-02, PNorm = 111.6550, GNorm = 0.3949, lr_0 = 9.9991e-04
Validation auc = 0.706754
Epoch 723
Loss = 3.5633e-02, PNorm = 111.7594, GNorm = 0.0868, lr_0 = 9.9991e-04
Validation auc = 0.689499
Epoch 724
Loss = 2.8233e-02, PNorm = 111.8595, GNorm = 0.1764, lr_0 = 9.9991e-04
Validation auc = 0.682442
Epoch 725
Loss = 8.0035e-02, PNorm = 111.9583, GNorm = 1.5939, lr_0 = 9.9991e-04
Validation auc = 0.715399
Epoch 726
Loss = 8.1839e-02, PNorm = 112.0910, GNorm = 0.1109, lr_0 = 9.9991e-04
Validation auc = 0.695731
Epoch 727
Loss = 3.7930e-02, PNorm = 112.2365, GNorm = 0.9811, lr_0 = 9.9991e-04
Validation auc = 0.695103
Epoch 728
Loss = 5.1812e-02, PNorm = 112.3539, GNorm = 0.6710, lr_0 = 9.9991e-04
Validation auc = 0.698079
Epoch 729
Loss = 1.1045e-01, PNorm = 112.4558, GNorm = 1.0827, lr_0 = 9.9991e-04
Loss = 6.3549e-02, PNorm = 112.5265, GNorm = 1.8790, lr_0 = 9.9991e-04
Validation auc = 0.700322
Epoch 730
Loss = 4.2133e-02, PNorm = 112.5968, GNorm = 0.2611, lr_0 = 9.9991e-04
Validation auc = 0.707820
Epoch 731
Loss = 2.1359e-02, PNorm = 112.6803, GNorm = 0.4247, lr_0 = 9.9991e-04
Validation auc = 0.701548
Epoch 732
Loss = 5.3900e-02, PNorm = 112.7686, GNorm = 0.9372, lr_0 = 9.9991e-04
Validation auc = 0.693088
Epoch 733
Loss = 5.5936e-02, PNorm = 112.8526, GNorm = 1.6774, lr_0 = 9.9990e-04
Validation auc = 0.692392
Epoch 734
Loss = 3.5816e-02, PNorm = 112.9529, GNorm = 2.1738, lr_0 = 9.9990e-04
Validation auc = 0.698517
Epoch 735
Loss = 5.2160e-02, PNorm = 113.0488, GNorm = 0.5231, lr_0 = 9.9990e-04
Validation auc = 0.702915
Epoch 736
Loss = 2.9886e-02, PNorm = 113.1286, GNorm = 1.2775, lr_0 = 9.9990e-04
Validation auc = 0.696073
Epoch 737
Loss = 4.5927e-02, PNorm = 113.2224, GNorm = 2.1975, lr_0 = 9.9990e-04
Validation auc = 0.718994
Epoch 738
Loss = 8.8377e-02, PNorm = 113.3088, GNorm = 1.1169, lr_0 = 9.9990e-04
Validation auc = 0.716721
Epoch 739
Loss = 9.6134e-03, PNorm = 113.3974, GNorm = 0.3012, lr_0 = 9.9990e-04
Loss = 4.9519e-02, PNorm = 113.4805, GNorm = 1.6729, lr_0 = 9.9990e-04
Validation auc = 0.713281
Epoch 740
Loss = 2.4630e-02, PNorm = 113.5824, GNorm = 1.4293, lr_0 = 9.9990e-04
Validation auc = 0.714522
Epoch 741
Loss = 3.0371e-02, PNorm = 113.6909, GNorm = 1.4075, lr_0 = 9.9990e-04
Validation auc = 0.721094
Epoch 742
Loss = 7.1338e-02, PNorm = 113.7748, GNorm = 0.3189, lr_0 = 9.9990e-04
Validation auc = 0.701509
Epoch 743
Loss = 4.0939e-02, PNorm = 113.8475, GNorm = 0.0803, lr_0 = 9.9990e-04
Validation auc = 0.679283
Epoch 744
Loss = 4.1285e-02, PNorm = 113.9305, GNorm = 0.3474, lr_0 = 9.9990e-04
Validation auc = 0.692917
Epoch 745
Loss = 2.8913e-02, PNorm = 114.0225, GNorm = 0.7405, lr_0 = 9.9990e-04
Validation auc = 0.708184
Epoch 746
Loss = 3.2334e-03, PNorm = 114.0994, GNorm = 0.0889, lr_0 = 9.9990e-04
Validation auc = 0.708908
Epoch 747
Loss = 2.0495e-02, PNorm = 114.1559, GNorm = 0.8370, lr_0 = 9.9989e-04
Validation auc = 0.698034
Epoch 748
Loss = 1.5707e-02, PNorm = 114.2396, GNorm = 0.2506, lr_0 = 9.9989e-04
Validation auc = 0.718417
Epoch 749
Loss = 1.4590e-02, PNorm = 114.3348, GNorm = 0.6395, lr_0 = 9.9989e-04
Loss = 5.0862e-02, PNorm = 114.4655, GNorm = 2.1698, lr_0 = 9.9989e-04
Validation auc = 0.718070
Epoch 750
Loss = 5.3614e-02, PNorm = 114.6046, GNorm = 1.3678, lr_0 = 9.9989e-04
Validation auc = 0.692759
Epoch 751
Loss = 5.1702e-02, PNorm = 114.7386, GNorm = 0.7163, lr_0 = 9.9989e-04
Validation auc = 0.710657
Epoch 752
Loss = 4.2509e-02, PNorm = 114.8582, GNorm = 0.2794, lr_0 = 9.9989e-04
Validation auc = 0.696837
Epoch 753
Loss = 5.2449e-02, PNorm = 115.0093, GNorm = 0.5830, lr_0 = 9.9989e-04
Validation auc = 0.708415
Epoch 754
Loss = 5.8808e-02, PNorm = 115.1500, GNorm = 0.6491, lr_0 = 9.9989e-04
Validation auc = 0.709422
Epoch 755
Loss = 2.0822e-02, PNorm = 115.2580, GNorm = 0.2250, lr_0 = 9.9989e-04
Validation auc = 0.696229
Epoch 756
Loss = 3.8992e-02, PNorm = 115.3709, GNorm = 0.7068, lr_0 = 9.9989e-04
Validation auc = 0.713197
Epoch 757
Loss = 6.4140e-02, PNorm = 115.4787, GNorm = 0.2068, lr_0 = 9.9989e-04
Validation auc = 0.716239
Epoch 758
Loss = 2.2751e-02, PNorm = 115.5703, GNorm = 1.5350, lr_0 = 9.9989e-04
Validation auc = 0.717912
Epoch 759
Loss = 1.5872e-02, PNorm = 115.6365, GNorm = 0.6422, lr_0 = 9.9989e-04
Loss = 4.1521e-02, PNorm = 115.7065, GNorm = 1.6659, lr_0 = 9.9988e-04
Validation auc = 0.713775
Epoch 760
Loss = 5.3272e-02, PNorm = 115.7742, GNorm = 0.8687, lr_0 = 9.9988e-04
Validation auc = 0.714713
Epoch 761
Loss = 4.6058e-02, PNorm = 115.8768, GNorm = 0.2792, lr_0 = 9.9988e-04
Validation auc = 0.723116
Epoch 762
Loss = 4.6805e-02, PNorm = 115.9988, GNorm = 1.1432, lr_0 = 9.9988e-04
Validation auc = 0.717766
Epoch 763
Loss = 6.8536e-02, PNorm = 116.1248, GNorm = 1.1635, lr_0 = 9.9988e-04
Validation auc = 0.736195
Epoch 764
Loss = 3.8289e-02, PNorm = 116.2667, GNorm = 0.9773, lr_0 = 9.9988e-04
Validation auc = 0.739265
Epoch 765
Loss = 2.8949e-02, PNorm = 116.3738, GNorm = 0.1402, lr_0 = 9.9988e-04
Validation auc = 0.736259
Epoch 766
Loss = 5.8270e-03, PNorm = 116.4464, GNorm = 0.4432, lr_0 = 9.9988e-04
Validation auc = 0.726173
Epoch 767
Loss = 7.2802e-02, PNorm = 116.5290, GNorm = 0.1605, lr_0 = 9.9988e-04
Validation auc = 0.730169
Epoch 768
Loss = 4.7978e-03, PNorm = 116.6147, GNorm = 0.2245, lr_0 = 9.9988e-04
Validation auc = 0.738455
Epoch 769
Loss = 1.2316e-02, PNorm = 116.6825, GNorm = 0.5596, lr_0 = 9.9988e-04
Loss = 4.0905e-02, PNorm = 116.7322, GNorm = 0.9797, lr_0 = 9.9988e-04
Validation auc = 0.723316
Epoch 770
Loss = 3.4413e-02, PNorm = 116.7918, GNorm = 0.1589, lr_0 = 9.9988e-04
Validation auc = 0.718368
Epoch 771
Loss = 6.4914e-02, PNorm = 116.8798, GNorm = 1.8340, lr_0 = 9.9988e-04
Validation auc = 0.712226
Epoch 772
Loss = 6.4682e-02, PNorm = 116.9856, GNorm = 0.9997, lr_0 = 9.9988e-04
Validation auc = 0.718438
Epoch 773
Loss = 3.9683e-02, PNorm = 117.0907, GNorm = 0.9876, lr_0 = 9.9987e-04
Validation auc = 0.720444
Epoch 774
Loss = 2.5951e-02, PNorm = 117.1780, GNorm = 0.3684, lr_0 = 9.9987e-04
Validation auc = 0.718255
Epoch 775
Loss = 5.7042e-03, PNorm = 117.2479, GNorm = 0.0414, lr_0 = 9.9987e-04
Validation auc = 0.701690
Epoch 776
Loss = 9.9948e-03, PNorm = 117.3160, GNorm = 0.1408, lr_0 = 9.9987e-04
Validation auc = 0.708741
Epoch 777
Loss = 1.3210e-02, PNorm = 117.3975, GNorm = 0.1320, lr_0 = 9.9987e-04
Validation auc = 0.718850
Epoch 778
Loss = 5.3856e-02, PNorm = 117.4676, GNorm = 0.0129, lr_0 = 9.9987e-04
Validation auc = 0.705817
Epoch 779
Loss = 3.6884e-02, PNorm = 117.6045, GNorm = 1.1701, lr_0 = 9.9987e-04
Loss = 3.4166e-02, PNorm = 117.7606, GNorm = 2.0865, lr_0 = 9.9987e-04
Validation auc = 0.712594
Epoch 780
Loss = 4.7460e-02, PNorm = 117.8987, GNorm = 0.0562, lr_0 = 9.9987e-04
Validation auc = 0.722278
Epoch 781
Loss = 1.9889e-02, PNorm = 118.0620, GNorm = 0.2278, lr_0 = 9.9987e-04
Validation auc = 0.723527
Epoch 782
Loss = 4.5158e-02, PNorm = 118.1854, GNorm = 0.5375, lr_0 = 9.9987e-04
Validation auc = 0.725990
Epoch 783
Loss = 6.6684e-02, PNorm = 118.2982, GNorm = 0.7855, lr_0 = 9.9987e-04
Validation auc = 0.744079
Epoch 784
Loss = 2.4257e-02, PNorm = 118.4205, GNorm = 0.1645, lr_0 = 9.9987e-04
Validation auc = 0.743226
Epoch 785
Loss = 6.0701e-02, PNorm = 118.5246, GNorm = 1.7717, lr_0 = 9.9987e-04
Validation auc = 0.732488
Epoch 786
Loss = 2.5064e-02, PNorm = 118.6430, GNorm = 0.6864, lr_0 = 9.9986e-04
Validation auc = 0.720361
Epoch 787
Loss = 4.8673e-02, PNorm = 118.7717, GNorm = 1.0401, lr_0 = 9.9986e-04
Validation auc = 0.737221
Epoch 788
Loss = 2.2464e-02, PNorm = 118.9175, GNorm = 0.2559, lr_0 = 9.9986e-04
Validation auc = 0.732971
Epoch 789
Loss = 3.8379e-02, PNorm = 119.0208, GNorm = 1.2488, lr_0 = 9.9986e-04
Loss = 3.8717e-02, PNorm = 119.1163, GNorm = 1.8811, lr_0 = 9.9986e-04
Validation auc = 0.727705
Epoch 790
Loss = 3.7907e-02, PNorm = 119.2021, GNorm = 1.9882, lr_0 = 9.9986e-04
Validation auc = 0.719996
Epoch 791
Loss = 4.1015e-02, PNorm = 119.3274, GNorm = 0.7987, lr_0 = 9.9986e-04
Validation auc = 0.728126
Epoch 792
Loss = 4.0954e-02, PNorm = 119.4403, GNorm = 2.4528, lr_0 = 9.9986e-04
Validation auc = 0.758969
Epoch 793
Loss = 5.7609e-02, PNorm = 119.5644, GNorm = 0.8616, lr_0 = 9.9986e-04
Validation auc = 0.752182
Epoch 794
Loss = 6.7221e-02, PNorm = 119.6942, GNorm = 2.3869, lr_0 = 9.9986e-04
Validation auc = 0.738418
Epoch 795
Loss = 6.1831e-02, PNorm = 119.8206, GNorm = 0.7274, lr_0 = 9.9986e-04
Validation auc = 0.747397
Epoch 796
Loss = 5.9389e-02, PNorm = 119.9484, GNorm = 0.6928, lr_0 = 9.9986e-04
Validation auc = 0.739405
Epoch 797
Loss = 2.1578e-02, PNorm = 120.0617, GNorm = 0.3373, lr_0 = 9.9986e-04
Validation auc = 0.735646
Epoch 798
Loss = 1.7794e-01, PNorm = 120.1736, GNorm = 2.3444, lr_0 = 9.9986e-04
Validation auc = 0.702853
Epoch 799
Loss = 2.7423e-02, PNorm = 120.3363, GNorm = 0.5352, lr_0 = 9.9986e-04
Loss = 7.6778e-02, PNorm = 120.5281, GNorm = 1.1039, lr_0 = 9.9985e-04
Validation auc = 0.717486
Epoch 800
Loss = 3.9306e-02, PNorm = 120.6765, GNorm = 0.4467, lr_0 = 9.9985e-04
Validation auc = 0.751259
Epoch 801
Loss = 3.3696e-02, PNorm = 120.8030, GNorm = 1.8828, lr_0 = 9.9985e-04
Validation auc = 0.755100
Epoch 802
Loss = 4.0068e-02, PNorm = 120.9056, GNorm = 0.0925, lr_0 = 9.9985e-04
Validation auc = 0.741289
Epoch 803
Loss = 5.1812e-02, PNorm = 121.0089, GNorm = 2.3041, lr_0 = 9.9985e-04
Validation auc = 0.728675
Epoch 804
Loss = 2.1603e-02, PNorm = 121.1010, GNorm = 0.3278, lr_0 = 9.9985e-04
Validation auc = 0.719201
Epoch 805
Loss = 3.2365e-02, PNorm = 121.2102, GNorm = 0.1570, lr_0 = 9.9985e-04
Validation auc = 0.733033
Epoch 806
Loss = 2.1577e-02, PNorm = 121.3032, GNorm = 2.0672, lr_0 = 9.9985e-04
Validation auc = 0.721627
Epoch 807
Loss = 3.7547e-02, PNorm = 121.4359, GNorm = 1.8898, lr_0 = 9.9985e-04
Validation auc = 0.728948
Epoch 808
Loss = 2.0653e-02, PNorm = 121.5426, GNorm = 1.6037, lr_0 = 9.9985e-04
Validation auc = 0.730115
Epoch 809
Loss = 9.9291e-03, PNorm = 121.6384, GNorm = 0.4985, lr_0 = 9.9985e-04
Loss = 2.9524e-02, PNorm = 121.7310, GNorm = 1.5902, lr_0 = 9.9985e-04
Validation auc = 0.722633
Epoch 810
Loss = 2.6399e-02, PNorm = 121.8151, GNorm = 0.3939, lr_0 = 9.9985e-04
Validation auc = 0.722612
Epoch 811
Loss = 2.5628e-02, PNorm = 121.8898, GNorm = 0.0947, lr_0 = 9.9985e-04
Validation auc = 0.692314
Epoch 812
Loss = 6.0899e-02, PNorm = 121.9763, GNorm = 1.1368, lr_0 = 9.9985e-04
Validation auc = 0.688161
Epoch 813
Loss = 2.0979e-02, PNorm = 122.0721, GNorm = 0.7631, lr_0 = 9.9984e-04
Validation auc = 0.714210
Epoch 814
Loss = 4.0518e-02, PNorm = 122.1655, GNorm = 0.3146, lr_0 = 9.9984e-04
Validation auc = 0.729362
Epoch 815
Loss = 2.8099e-02, PNorm = 122.2369, GNorm = 0.6782, lr_0 = 9.9984e-04
Validation auc = 0.732407
Epoch 816
Loss = 1.2854e-02, PNorm = 122.3177, GNorm = 0.3683, lr_0 = 9.9984e-04
Validation auc = 0.735526
Epoch 817
Loss = 2.2575e-02, PNorm = 122.3931, GNorm = 0.8790, lr_0 = 9.9984e-04
Validation auc = 0.718470
Epoch 818
Loss = 1.7704e-02, PNorm = 122.4914, GNorm = 0.0482, lr_0 = 9.9984e-04
Validation auc = 0.676233
Epoch 819
Loss = 2.6496e-01, PNorm = 122.5746, GNorm = 2.5050, lr_0 = 9.9984e-04
Loss = 2.6923e-02, PNorm = 122.6608, GNorm = 0.9168, lr_0 = 9.9984e-04
Validation auc = 0.701957
Epoch 820
Loss = 5.7622e-02, PNorm = 122.7850, GNorm = 2.5756, lr_0 = 9.9984e-04
Validation auc = 0.714401
Epoch 821
Loss = 3.6287e-02, PNorm = 122.9107, GNorm = 3.1434, lr_0 = 9.9984e-04
Validation auc = 0.720909
Epoch 822
Loss = 5.7041e-02, PNorm = 123.0562, GNorm = 0.8139, lr_0 = 9.9984e-04
Validation auc = 0.712970
Epoch 823
Loss = 2.5400e-02, PNorm = 123.1764, GNorm = 2.6285, lr_0 = 9.9984e-04
Validation auc = 0.691160
Epoch 824
Loss = 3.4389e-02, PNorm = 123.2899, GNorm = 1.1757, lr_0 = 9.9984e-04
Validation auc = 0.697032
Epoch 825
Loss = 3.8359e-02, PNorm = 123.3848, GNorm = 0.0739, lr_0 = 9.9984e-04
Validation auc = 0.701538
Epoch 826
Loss = 4.3081e-02, PNorm = 123.4850, GNorm = 0.4120, lr_0 = 9.9983e-04
Validation auc = 0.698596
Epoch 827
Loss = 9.3777e-02, PNorm = 123.6143, GNorm = 0.7589, lr_0 = 9.9983e-04
Validation auc = 0.703623
Epoch 828
Loss = 1.3673e-01, PNorm = 123.7477, GNorm = 1.5302, lr_0 = 9.9983e-04
Validation auc = 0.703041
Epoch 829
Loss = 1.7077e-02, PNorm = 123.8734, GNorm = 0.3516, lr_0 = 9.9983e-04
Loss = 4.6845e-02, PNorm = 123.9817, GNorm = 2.3988, lr_0 = 9.9983e-04
Validation auc = 0.701859
Epoch 830
Loss = 3.2790e-02, PNorm = 124.1127, GNorm = 0.8696, lr_0 = 9.9983e-04
Validation auc = 0.712783
Epoch 831
Loss = 1.3559e-02, PNorm = 124.2204, GNorm = 0.1144, lr_0 = 9.9983e-04
Validation auc = 0.710783
Epoch 832
Loss = 8.1828e-02, PNorm = 124.3243, GNorm = 2.7944, lr_0 = 9.9983e-04
Validation auc = 0.717605
Epoch 833
Loss = 1.0768e-01, PNorm = 124.4644, GNorm = 4.2163, lr_0 = 9.9983e-04
Validation auc = 0.726381
Epoch 834
Loss = 7.4585e-02, PNorm = 124.6287, GNorm = 1.2010, lr_0 = 9.9983e-04
Validation auc = 0.720086
Epoch 835
Loss = 4.4133e-02, PNorm = 124.7469, GNorm = 1.0483, lr_0 = 9.9983e-04
Validation auc = 0.715482
Epoch 836
Loss = 2.2173e-02, PNorm = 124.8433, GNorm = 0.0860, lr_0 = 9.9983e-04
Validation auc = 0.719873
Epoch 837
Loss = 3.7297e-02, PNorm = 124.9248, GNorm = 0.1213, lr_0 = 9.9983e-04
Validation auc = 0.728150
Epoch 838
Loss = 5.5561e-03, PNorm = 124.9942, GNorm = 0.1858, lr_0 = 9.9983e-04
Validation auc = 0.709355
Epoch 839
Loss = 3.7231e-03, PNorm = 125.0824, GNorm = 0.0842, lr_0 = 9.9983e-04
Loss = 2.8100e-02, PNorm = 125.1708, GNorm = 0.6124, lr_0 = 9.9982e-04
Validation auc = 0.704903
Epoch 840
Loss = 4.1676e-02, PNorm = 125.2498, GNorm = 2.2935, lr_0 = 9.9982e-04
Validation auc = 0.732929
Epoch 841
Loss = 2.8900e-02, PNorm = 125.3529, GNorm = 0.6747, lr_0 = 9.9982e-04
Validation auc = 0.736036
Epoch 842
Loss = 8.2638e-02, PNorm = 125.4401, GNorm = 1.0855, lr_0 = 9.9982e-04
Validation auc = 0.715265
Epoch 843
Loss = 4.7699e-02, PNorm = 125.5623, GNorm = 0.8994, lr_0 = 9.9982e-04
Validation auc = 0.718928
Epoch 844
Loss = 3.4297e-02, PNorm = 125.6789, GNorm = 0.1565, lr_0 = 9.9982e-04
Validation auc = 0.727008
Epoch 845
Loss = 2.8412e-02, PNorm = 125.7861, GNorm = 1.9620, lr_0 = 9.9982e-04
Validation auc = 0.719299
Epoch 846
Loss = 1.0437e-01, PNorm = 125.8864, GNorm = 1.5629, lr_0 = 9.9982e-04
Validation auc = 0.707246
Epoch 847
Loss = 3.5260e-02, PNorm = 126.0176, GNorm = 0.3061, lr_0 = 9.9982e-04
Validation auc = 0.717311
Epoch 848
Loss = 3.0025e-02, PNorm = 126.1484, GNorm = 0.1977, lr_0 = 9.9982e-04
Validation auc = 0.715569
Epoch 849
Loss = 4.3054e-02, PNorm = 126.2836, GNorm = 1.3737, lr_0 = 9.9982e-04
Loss = 4.7081e-02, PNorm = 126.4361, GNorm = 0.9348, lr_0 = 9.9982e-04
Validation auc = 0.715470
Epoch 850
Loss = 5.1526e-02, PNorm = 126.5682, GNorm = 0.3077, lr_0 = 9.9982e-04
Validation auc = 0.711766
Epoch 851
Loss = 3.3725e-02, PNorm = 126.6665, GNorm = 0.4309, lr_0 = 9.9982e-04
Validation auc = 0.717819
Epoch 852
Loss = 1.0209e-02, PNorm = 126.7414, GNorm = 0.2127, lr_0 = 9.9981e-04
Validation auc = 0.723268
Epoch 853
Loss = 3.2296e-02, PNorm = 126.8197, GNorm = 0.6311, lr_0 = 9.9981e-04
Validation auc = 0.727046
Epoch 854
Loss = 5.8416e-02, PNorm = 126.8692, GNorm = 0.9243, lr_0 = 9.9981e-04
Validation auc = 0.742131
Epoch 855
Loss = 2.8966e-02, PNorm = 126.9752, GNorm = 0.1828, lr_0 = 9.9981e-04
Validation auc = 0.738803
Epoch 856
Loss = 1.9411e-02, PNorm = 127.0773, GNorm = 0.8067, lr_0 = 9.9981e-04
Validation auc = 0.736826
Epoch 857
Loss = 7.3483e-03, PNorm = 127.1668, GNorm = 0.0529, lr_0 = 9.9981e-04
Validation auc = 0.718278
Epoch 858
Loss = 5.8662e-02, PNorm = 127.2569, GNorm = 0.7073, lr_0 = 9.9981e-04
Validation auc = 0.716562
Epoch 859
Loss = 4.7201e-03, PNorm = 127.3445, GNorm = 0.1548, lr_0 = 9.9981e-04
Loss = 3.8102e-02, PNorm = 127.4101, GNorm = 0.0984, lr_0 = 9.9981e-04
Validation auc = 0.717246
Epoch 860
Loss = 3.1336e-02, PNorm = 127.4556, GNorm = 0.9158, lr_0 = 9.9981e-04
Validation auc = 0.711826
Epoch 861
Loss = 3.7510e-02, PNorm = 127.5076, GNorm = 2.7573, lr_0 = 9.9981e-04
Validation auc = 0.713330
Epoch 862
Loss = 2.5454e-02, PNorm = 127.5697, GNorm = 0.9842, lr_0 = 9.9981e-04
Validation auc = 0.729061
Epoch 863
Loss = 5.9279e-02, PNorm = 127.6723, GNorm = 3.1240, lr_0 = 9.9981e-04
Validation auc = 0.737621
Epoch 864
Loss = 4.2898e-02, PNorm = 127.7795, GNorm = 1.4023, lr_0 = 9.9981e-04
Validation auc = 0.754495
Epoch 865
Loss = 2.5260e-02, PNorm = 127.9064, GNorm = 0.9213, lr_0 = 9.9981e-04
Validation auc = 0.745102
Epoch 866
Loss = 1.8334e-02, PNorm = 128.0091, GNorm = 0.7407, lr_0 = 9.9980e-04
Validation auc = 0.723825
Epoch 867
Loss = 4.2096e-02, PNorm = 128.1020, GNorm = 0.7463, lr_0 = 9.9980e-04
Validation auc = 0.721676
Epoch 868
Loss = 8.7764e-04, PNorm = 128.1818, GNorm = 0.0142, lr_0 = 9.9980e-04
Validation auc = 0.734378
Epoch 869
Loss = 2.6492e-03, PNorm = 128.2481, GNorm = 0.0863, lr_0 = 9.9980e-04
Loss = 3.1207e-02, PNorm = 128.3132, GNorm = 2.0539, lr_0 = 9.9980e-04
Validation auc = 0.724379
Epoch 870
Loss = 3.2003e-02, PNorm = 128.3783, GNorm = 2.0513, lr_0 = 9.9980e-04
Validation auc = 0.721910
Epoch 871
Loss = 4.1137e-02, PNorm = 128.4497, GNorm = 0.2651, lr_0 = 9.9980e-04
Validation auc = 0.719397
Epoch 872
Loss = 3.7962e-02, PNorm = 128.5289, GNorm = 0.0637, lr_0 = 9.9980e-04
Validation auc = 0.728571
Epoch 873
Loss = 2.0684e-02, PNorm = 128.6074, GNorm = 0.0643, lr_0 = 9.9980e-04
Validation auc = 0.730878
Epoch 874
Loss = 5.4083e-02, PNorm = 128.6814, GNorm = 1.3626, lr_0 = 9.9980e-04
Validation auc = 0.733095
Epoch 875
Loss = 2.9701e-02, PNorm = 128.7574, GNorm = 0.0597, lr_0 = 9.9980e-04
Validation auc = 0.742180
Epoch 876
Loss = 2.0952e-02, PNorm = 128.8309, GNorm = 0.8450, lr_0 = 9.9980e-04
Validation auc = 0.753927
Epoch 877
Loss = 1.0115e-01, PNorm = 128.8896, GNorm = 1.4513, lr_0 = 9.9980e-04
Validation auc = 0.751715
Epoch 878
Loss = 1.2488e-02, PNorm = 128.9552, GNorm = 0.8122, lr_0 = 9.9980e-04
Validation auc = 0.751259
Epoch 879
Loss = 1.3491e-03, PNorm = 129.0110, GNorm = 0.0420, lr_0 = 9.9979e-04
Loss = 4.4689e-02, PNorm = 129.0916, GNorm = 0.8765, lr_0 = 9.9979e-04
Validation auc = 0.735373
Epoch 880
Loss = 6.1044e-02, PNorm = 129.1731, GNorm = 3.2583, lr_0 = 9.9979e-04
Validation auc = 0.734766
Epoch 881
Loss = 3.5124e-02, PNorm = 129.2878, GNorm = 0.9338, lr_0 = 9.9979e-04
Validation auc = 0.738280
Epoch 882
Loss = 3.7211e-02, PNorm = 129.3904, GNorm = 1.7860, lr_0 = 9.9979e-04
Validation auc = 0.737707
Epoch 883
Loss = 1.2661e-02, PNorm = 129.4858, GNorm = 0.8537, lr_0 = 9.9979e-04
Validation auc = 0.733704
Epoch 884
Loss = 5.1496e-02, PNorm = 129.5666, GNorm = 1.4146, lr_0 = 9.9979e-04
Validation auc = 0.736237
Epoch 885
Loss = 3.9676e-02, PNorm = 129.6586, GNorm = 1.0596, lr_0 = 9.9979e-04
Validation auc = 0.734412
Epoch 886
Loss = 3.1442e-02, PNorm = 129.7549, GNorm = 0.0517, lr_0 = 9.9979e-04
Validation auc = 0.724055
Epoch 887
Loss = 8.6408e-02, PNorm = 129.8520, GNorm = 1.4530, lr_0 = 9.9979e-04
Validation auc = 0.722569
Epoch 888
Loss = 1.9311e-02, PNorm = 129.9678, GNorm = 0.1701, lr_0 = 9.9979e-04
Validation auc = 0.725997
Epoch 889
Loss = 1.4069e-03, PNorm = 130.0714, GNorm = 0.0262, lr_0 = 9.9979e-04
Loss = 4.2533e-02, PNorm = 130.1488, GNorm = 0.2632, lr_0 = 9.9979e-04
Validation auc = 0.724412
Epoch 890
Loss = 1.8894e-02, PNorm = 130.2297, GNorm = 0.0147, lr_0 = 9.9979e-04
Validation auc = 0.728811
Epoch 891
Loss = 5.3305e-02, PNorm = 130.3266, GNorm = 3.2307, lr_0 = 9.9979e-04
Validation auc = 0.729566
Epoch 892
Loss = 3.5363e-02, PNorm = 130.4189, GNorm = 0.5734, lr_0 = 9.9978e-04
Validation auc = 0.720941
Epoch 893
Loss = 8.9162e-02, PNorm = 130.5032, GNorm = 0.9554, lr_0 = 9.9978e-04
Validation auc = 0.717468
Epoch 894
Loss = 6.6073e-02, PNorm = 130.6201, GNorm = 1.4872, lr_0 = 9.9978e-04
Validation auc = 0.713805
Epoch 895
Loss = 5.6048e-02, PNorm = 130.7295, GNorm = 2.7983, lr_0 = 9.9978e-04
Validation auc = 0.724505
Epoch 896
Loss = 8.0846e-02, PNorm = 130.8377, GNorm = 0.7549, lr_0 = 9.9978e-04
Validation auc = 0.737790
Epoch 897
Loss = 2.4865e-02, PNorm = 130.9625, GNorm = 0.9679, lr_0 = 9.9978e-04
Validation auc = 0.733336
Epoch 898
Loss = 8.3406e-03, PNorm = 131.0914, GNorm = 0.5494, lr_0 = 9.9978e-04
Validation auc = 0.730959
Epoch 899
Loss = 2.5108e-03, PNorm = 131.1630, GNorm = 0.1197, lr_0 = 9.9978e-04
Loss = 4.1130e-02, PNorm = 131.2306, GNorm = 2.5072, lr_0 = 9.9978e-04
Validation auc = 0.721138
Epoch 900
Loss = 3.3219e-02, PNorm = 131.3310, GNorm = 0.8425, lr_0 = 9.9978e-04
Validation auc = 0.685820
Epoch 901
Loss = 3.9791e-02, PNorm = 131.4376, GNorm = 2.0008, lr_0 = 9.9978e-04
Validation auc = 0.690233
Epoch 902
Loss = 3.2651e-02, PNorm = 131.5302, GNorm = 1.7014, lr_0 = 9.9978e-04
Validation auc = 0.710352
Epoch 903
Loss = 2.5584e-02, PNorm = 131.6137, GNorm = 0.0567, lr_0 = 9.9978e-04
Validation auc = 0.715613
Epoch 904
Loss = 1.8736e-02, PNorm = 131.6918, GNorm = 1.0785, lr_0 = 9.9978e-04
Validation auc = 0.731509
Epoch 905
Loss = 4.2414e-02, PNorm = 131.7576, GNorm = 0.4698, lr_0 = 9.9977e-04
Validation auc = 0.730777
Epoch 906
Loss = 4.7036e-02, PNorm = 131.8339, GNorm = 1.9781, lr_0 = 9.9977e-04
Validation auc = 0.723446
Epoch 907
Loss = 5.5530e-02, PNorm = 131.9080, GNorm = 0.7117, lr_0 = 9.9977e-04
Validation auc = 0.733227
Epoch 908
Loss = 2.3161e-02, PNorm = 131.9774, GNorm = 0.0973, lr_0 = 9.9977e-04
Validation auc = 0.739708
Epoch 909
Loss = 1.1546e-01, PNorm = 132.0993, GNorm = 1.1375, lr_0 = 9.9977e-04
Loss = 3.8040e-02, PNorm = 132.2031, GNorm = 0.7004, lr_0 = 9.9977e-04
Validation auc = 0.743300
Epoch 910
Loss = 2.9215e-02, PNorm = 132.3124, GNorm = 0.1787, lr_0 = 9.9977e-04
Validation auc = 0.744217
Epoch 911
Loss = 3.4631e-02, PNorm = 132.3960, GNorm = 0.1469, lr_0 = 9.9977e-04
Validation auc = 0.743687
Epoch 912
Loss = 3.3328e-02, PNorm = 132.4689, GNorm = 0.0849, lr_0 = 9.9977e-04
Validation auc = 0.713975
Epoch 913
Loss = 3.0505e-02, PNorm = 132.5474, GNorm = 0.7241, lr_0 = 9.9977e-04
Validation auc = 0.701168
Epoch 914
Loss = 4.1976e-02, PNorm = 132.6301, GNorm = 0.8262, lr_0 = 9.9977e-04
Validation auc = 0.723349
Epoch 915
Loss = 7.2594e-02, PNorm = 132.7209, GNorm = 0.8167, lr_0 = 9.9977e-04
Validation auc = 0.725105
Epoch 916
Loss = 1.5409e-02, PNorm = 132.8165, GNorm = 0.1937, lr_0 = 9.9977e-04
Validation auc = 0.735047
Epoch 917
Loss = 4.0002e-02, PNorm = 132.9457, GNorm = 1.0623, lr_0 = 9.9977e-04
Validation auc = 0.743375
Epoch 918
Loss = 8.1150e-03, PNorm = 133.0614, GNorm = 0.3409, lr_0 = 9.9977e-04
Validation auc = 0.734467
Epoch 919
Loss = 8.6246e-03, PNorm = 133.1608, GNorm = 0.1737, lr_0 = 9.9976e-04
Loss = 2.7182e-02, PNorm = 133.2550, GNorm = 0.0458, lr_0 = 9.9976e-04
Validation auc = 0.728990
Epoch 920
Loss = 5.5263e-02, PNorm = 133.3554, GNorm = 0.2486, lr_0 = 9.9976e-04
Validation auc = 0.720063
Epoch 921
Loss = 3.6540e-02, PNorm = 133.5060, GNorm = 1.3834, lr_0 = 9.9976e-04
Validation auc = 0.737062
Epoch 922
Loss = 5.4228e-02, PNorm = 133.6574, GNorm = 0.3276, lr_0 = 9.9976e-04
Validation auc = 0.719592
Epoch 923
Loss = 2.7200e-02, PNorm = 133.7848, GNorm = 0.5243, lr_0 = 9.9976e-04
Validation auc = 0.711112
Epoch 924
Loss = 1.7685e-02, PNorm = 133.8851, GNorm = 0.4960, lr_0 = 9.9976e-04
Validation auc = 0.712685
Epoch 925
Loss = 4.3797e-02, PNorm = 133.9704, GNorm = 0.9523, lr_0 = 9.9976e-04
Validation auc = 0.739137
Epoch 926
Loss = 2.1453e-02, PNorm = 134.0857, GNorm = 1.0215, lr_0 = 9.9976e-04
Validation auc = 0.737193
Epoch 927
Loss = 5.1533e-02, PNorm = 134.2040, GNorm = 2.3004, lr_0 = 9.9976e-04
Validation auc = 0.712222
Epoch 928
Loss = 3.5329e-02, PNorm = 134.3719, GNorm = 0.6829, lr_0 = 9.9976e-04
Validation auc = 0.729794
Epoch 929
Loss = 9.6366e-03, PNorm = 134.5016, GNorm = 0.4090, lr_0 = 9.9976e-04
Loss = 2.1331e-02, PNorm = 134.6191, GNorm = 0.7563, lr_0 = 9.9976e-04
Validation auc = 0.736586
Epoch 930
Loss = 1.6224e-02, PNorm = 134.7048, GNorm = 0.3465, lr_0 = 9.9976e-04
Validation auc = 0.742936
Epoch 931
Loss = 8.8310e-02, PNorm = 134.7998, GNorm = 1.3011, lr_0 = 9.9975e-04
Validation auc = 0.747628
Epoch 932
Loss = 1.7856e-02, PNorm = 134.8919, GNorm = 0.4370, lr_0 = 9.9975e-04
Validation auc = 0.748533
Epoch 933
Loss = 2.7876e-02, PNorm = 134.9902, GNorm = 0.1580, lr_0 = 9.9975e-04
Validation auc = 0.748857
Epoch 934
Loss = 7.5889e-03, PNorm = 135.0657, GNorm = 0.2224, lr_0 = 9.9975e-04
Validation auc = 0.748560
Epoch 935
Loss = 1.7179e-02, PNorm = 135.1469, GNorm = 0.3473, lr_0 = 9.9975e-04
Validation auc = 0.744274
Epoch 936
Loss = 1.1811e-02, PNorm = 135.2341, GNorm = 0.0838, lr_0 = 9.9975e-04
Validation auc = 0.705205
Epoch 937
Loss = 1.1848e-01, PNorm = 135.3746, GNorm = 0.1177, lr_0 = 9.9975e-04
Validation auc = 0.733928
Epoch 938
Loss = 5.4007e-02, PNorm = 135.5157, GNorm = 1.8461, lr_0 = 9.9975e-04
Validation auc = 0.732222
Epoch 939
Loss = 1.2693e-02, PNorm = 135.6343, GNorm = 0.4259, lr_0 = 9.9975e-04
Loss = 2.7740e-02, PNorm = 135.7452, GNorm = 1.1175, lr_0 = 9.9975e-04
Validation auc = 0.716860
Epoch 940
Loss = 4.8081e-02, PNorm = 135.8759, GNorm = 1.5565, lr_0 = 9.9975e-04
Validation auc = 0.741235
Epoch 941
Loss = 6.1697e-02, PNorm = 136.0202, GNorm = 0.6295, lr_0 = 9.9975e-04
Validation auc = 0.757932
Epoch 942
Loss = 2.7465e-02, PNorm = 136.1186, GNorm = 0.4677, lr_0 = 9.9975e-04
Validation auc = 0.744084
Epoch 943
Loss = 4.1240e-02, PNorm = 136.2199, GNorm = 0.4405, lr_0 = 9.9975e-04
Validation auc = 0.729660
Epoch 944
Loss = 5.5540e-02, PNorm = 136.3107, GNorm = 0.1447, lr_0 = 9.9975e-04
Validation auc = 0.725381
Epoch 945
Loss = 1.8215e-02, PNorm = 136.3985, GNorm = 1.6803, lr_0 = 9.9974e-04
Validation auc = 0.735540
Epoch 946
Loss = 1.4104e-02, PNorm = 136.4759, GNorm = 0.2428, lr_0 = 9.9974e-04
Validation auc = 0.745473
Epoch 947
Loss = 5.8144e-02, PNorm = 136.5356, GNorm = 1.3975, lr_0 = 9.9974e-04
Validation auc = 0.738718
Epoch 948
Loss = 1.1973e-02, PNorm = 136.6181, GNorm = 0.2338, lr_0 = 9.9974e-04
Validation auc = 0.727148
Epoch 949
Loss = 6.4631e-02, PNorm = 136.6940, GNorm = 1.9737, lr_0 = 9.9974e-04
Loss = 3.2808e-02, PNorm = 136.7777, GNorm = 0.2063, lr_0 = 9.9974e-04
Validation auc = 0.713306
Epoch 950
Loss = 5.3845e-02, PNorm = 136.8672, GNorm = 0.2378, lr_0 = 9.9974e-04
Validation auc = 0.719811
Epoch 951
Loss = 3.0305e-02, PNorm = 136.9486, GNorm = 1.0226, lr_0 = 9.9974e-04
Validation auc = 0.731288
Epoch 952
Loss = 3.9823e-02, PNorm = 137.0365, GNorm = 0.8207, lr_0 = 9.9974e-04
Validation auc = 0.747655
Epoch 953
Loss = 6.5571e-02, PNorm = 137.1355, GNorm = 0.3434, lr_0 = 9.9974e-04
Validation auc = 0.764935
Epoch 954
Loss = 6.2160e-02, PNorm = 137.2679, GNorm = 1.1982, lr_0 = 9.9974e-04
Validation auc = 0.763368
Epoch 955
Loss = 6.6317e-02, PNorm = 137.4129, GNorm = 0.4429, lr_0 = 9.9974e-04
Validation auc = 0.758618
Epoch 956
Loss = 3.7392e-02, PNorm = 137.5098, GNorm = 1.2005, lr_0 = 9.9974e-04
Validation auc = 0.746665
Epoch 957
Loss = 1.4292e-02, PNorm = 137.5992, GNorm = 1.1735, lr_0 = 9.9974e-04
Validation auc = 0.727918
Epoch 958
Loss = 4.4754e-03, PNorm = 137.6846, GNorm = 0.7428, lr_0 = 9.9973e-04
Validation auc = 0.734494
Epoch 959
Loss = 2.7655e-02, PNorm = 137.7792, GNorm = 1.4272, lr_0 = 9.9973e-04
Loss = 1.8847e-02, PNorm = 137.8692, GNorm = 0.1377, lr_0 = 9.9973e-04
Validation auc = 0.737401
Epoch 960
Loss = 3.7482e-02, PNorm = 137.9711, GNorm = 0.3576, lr_0 = 9.9973e-04
Validation auc = 0.742307
Epoch 961
Loss = 2.5854e-02, PNorm = 138.0549, GNorm = 1.4558, lr_0 = 9.9973e-04
Validation auc = 0.739039
Epoch 962
Loss = 2.8121e-02, PNorm = 138.1348, GNorm = 0.0659, lr_0 = 9.9973e-04
Validation auc = 0.748269
Epoch 963
Loss = 3.1710e-02, PNorm = 138.1893, GNorm = 1.8783, lr_0 = 9.9973e-04
Validation auc = 0.752805
Epoch 964
Loss = 3.4006e-02, PNorm = 138.2602, GNorm = 0.6131, lr_0 = 9.9973e-04
Validation auc = 0.742813
Epoch 965
Loss = 8.4066e-03, PNorm = 138.3255, GNorm = 1.2060, lr_0 = 9.9973e-04
Validation auc = 0.737065
Epoch 966
Loss = 3.0531e-02, PNorm = 138.3918, GNorm = 2.7272, lr_0 = 9.9973e-04
Validation auc = 0.746211
Epoch 967
Loss = 7.2201e-02, PNorm = 138.5183, GNorm = 0.9322, lr_0 = 9.9973e-04
Validation auc = 0.721477
Epoch 968
Loss = 4.3774e-02, PNorm = 138.7149, GNorm = 1.7067, lr_0 = 9.9973e-04
Validation auc = 0.719929
Epoch 969
Loss = 3.0650e-02, PNorm = 138.8771, GNorm = 0.7711, lr_0 = 9.9973e-04
Loss = 5.3890e-02, PNorm = 139.0078, GNorm = 2.6190, lr_0 = 9.9973e-04
Validation auc = 0.731815
Epoch 970
Loss = 3.6142e-02, PNorm = 139.1162, GNorm = 0.5978, lr_0 = 9.9973e-04
Validation auc = 0.728559
Epoch 971
Loss = 4.6726e-02, PNorm = 139.2278, GNorm = 0.4762, lr_0 = 9.9972e-04
Validation auc = 0.723677
Epoch 972
Loss = 6.3444e-02, PNorm = 139.3251, GNorm = 0.7507, lr_0 = 9.9972e-04
Validation auc = 0.723557
Epoch 973
Loss = 2.9954e-02, PNorm = 139.4294, GNorm = 1.2112, lr_0 = 9.9972e-04
Validation auc = 0.724617
Epoch 974
Loss = 3.0890e-02, PNorm = 139.5042, GNorm = 0.0415, lr_0 = 9.9972e-04
Validation auc = 0.715390
Epoch 975
Loss = 1.6121e-02, PNorm = 139.5860, GNorm = 3.0375, lr_0 = 9.9972e-04
Validation auc = 0.717744
Epoch 976
Loss = 2.8188e-02, PNorm = 139.7041, GNorm = 0.8469, lr_0 = 9.9972e-04
Validation auc = 0.744008
Epoch 977
Loss = 1.1792e-01, PNorm = 139.8622, GNorm = 2.8283, lr_0 = 9.9972e-04
Validation auc = 0.748190
Epoch 978
Loss = 3.0970e-03, PNorm = 139.9796, GNorm = 0.0704, lr_0 = 9.9972e-04
Validation auc = 0.733859
Epoch 979
Loss = 1.1794e-02, PNorm = 140.0937, GNorm = 0.3242, lr_0 = 9.9972e-04
Loss = 3.3721e-02, PNorm = 140.1898, GNorm = 0.9447, lr_0 = 9.9972e-04
Validation auc = 0.731556
Epoch 980
Loss = 3.8906e-02, PNorm = 140.2551, GNorm = 0.2034, lr_0 = 9.9972e-04
Validation auc = 0.736621
Epoch 981
Loss = 4.1204e-02, PNorm = 140.3309, GNorm = 0.2573, lr_0 = 9.9972e-04
Validation auc = 0.745207
Epoch 982
Loss = 1.4422e-02, PNorm = 140.3838, GNorm = 1.3139, lr_0 = 9.9972e-04
Validation auc = 0.747529
Epoch 983
Loss = 1.3017e-02, PNorm = 140.4749, GNorm = 2.1465, lr_0 = 9.9972e-04
Validation auc = 0.733709
Epoch 984
Loss = 4.6804e-02, PNorm = 140.5644, GNorm = 1.4081, lr_0 = 9.9971e-04
Validation auc = 0.719063
Epoch 985
Loss = 7.4650e-02, PNorm = 140.6855, GNorm = 0.6321, lr_0 = 9.9971e-04
Validation auc = 0.733520
Epoch 986
Loss = 4.1896e-02, PNorm = 140.7842, GNorm = 1.7600, lr_0 = 9.9971e-04
Validation auc = 0.710737
Epoch 987
Loss = 2.3928e-02, PNorm = 140.8779, GNorm = 0.3223, lr_0 = 9.9971e-04
Validation auc = 0.691524
Epoch 988
Loss = 8.2709e-02, PNorm = 140.9789, GNorm = 1.1285, lr_0 = 9.9971e-04
Validation auc = 0.702811
Epoch 989
Loss = 3.4524e-02, PNorm = 141.0755, GNorm = 2.4664, lr_0 = 9.9971e-04
Loss = 3.2654e-02, PNorm = 141.1722, GNorm = 1.4934, lr_0 = 9.9971e-04
Validation auc = 0.722499
Epoch 990
Loss = 2.8041e-02, PNorm = 141.2624, GNorm = 0.6639, lr_0 = 9.9971e-04
Validation auc = 0.732092
Epoch 991
Loss = 1.4939e-02, PNorm = 141.3569, GNorm = 0.0655, lr_0 = 9.9971e-04
Validation auc = 0.710133
Epoch 992
Loss = 2.0083e-02, PNorm = 141.4216, GNorm = 0.6113, lr_0 = 9.9971e-04
Validation auc = 0.709440
Epoch 993
Loss = 9.4108e-02, PNorm = 141.4675, GNorm = 1.4363, lr_0 = 9.9971e-04
Validation auc = 0.687632
Epoch 994
Loss = 2.7858e-02, PNorm = 141.5460, GNorm = 0.6473, lr_0 = 9.9971e-04
Validation auc = 0.687076
Epoch 995
Loss = 1.8238e-02, PNorm = 141.6263, GNorm = 0.2236, lr_0 = 9.9971e-04
Validation auc = 0.690858
Epoch 996
Loss = 5.2553e-02, PNorm = 141.7042, GNorm = 1.0519, lr_0 = 9.9971e-04
Validation auc = 0.707533
Epoch 997
Loss = 3.9300e-02, PNorm = 141.8005, GNorm = 0.6484, lr_0 = 9.9971e-04
Validation auc = 0.676621
Epoch 998
Loss = 2.1774e-02, PNorm = 141.9088, GNorm = 0.0993, lr_0 = 9.9970e-04
Validation auc = 0.686137
Epoch 999
Loss = 8.3146e-03, PNorm = 142.0251, GNorm = 0.1808, lr_0 = 9.9970e-04
Loss = 2.7100e-02, PNorm = 142.1210, GNorm = 0.8537, lr_0 = 9.9970e-04
Validation auc = 0.706416
Epoch 1000
Loss = 3.4773e-02, PNorm = 142.2174, GNorm = 0.2496, lr_0 = 9.9970e-04
Validation auc = 0.710088
Epoch 1001
Loss = 1.3308e-02, PNorm = 142.2928, GNorm = 0.0272, lr_0 = 9.9970e-04
Validation auc = 0.709958
Epoch 1002
Loss = 5.3182e-02, PNorm = 142.3866, GNorm = 2.6104, lr_0 = 9.9970e-04
Validation auc = 0.729902
Epoch 1003
Loss = 6.5733e-02, PNorm = 142.4787, GNorm = 0.0678, lr_0 = 9.9970e-04
Validation auc = 0.721574
Epoch 1004
Loss = 8.9555e-02, PNorm = 142.5945, GNorm = 1.3431, lr_0 = 9.9970e-04
Validation auc = 0.708390
Epoch 1005
Loss = 3.3289e-02, PNorm = 142.7071, GNorm = 0.2342, lr_0 = 9.9970e-04
Validation auc = 0.705216
Epoch 1006
Loss = 2.1605e-02, PNorm = 142.7978, GNorm = 0.7582, lr_0 = 9.9970e-04
Validation auc = 0.718900
Epoch 1007
Loss = 2.6110e-02, PNorm = 142.8870, GNorm = 1.0610, lr_0 = 9.9970e-04
Validation auc = 0.730818
Epoch 1008
Loss = 1.0584e-02, PNorm = 142.9717, GNorm = 0.7878, lr_0 = 9.9970e-04
Validation auc = 0.726927
Epoch 1009
Loss = 1.1562e-01, PNorm = 143.0569, GNorm = 3.1358, lr_0 = 9.9970e-04
Loss = 2.3362e-02, PNorm = 143.1613, GNorm = 0.0974, lr_0 = 9.9970e-04
Validation auc = 0.710334
Epoch 1010
Loss = 4.5587e-02, PNorm = 143.2540, GNorm = 0.2928, lr_0 = 9.9969e-04
Validation auc = 0.710943
Epoch 1011
Loss = 5.3212e-02, PNorm = 143.3655, GNorm = 1.3398, lr_0 = 9.9969e-04
Validation auc = 0.716416
Epoch 1012
Loss = 2.9867e-02, PNorm = 143.4666, GNorm = 1.8889, lr_0 = 9.9969e-04
Validation auc = 0.720767
Epoch 1013
Loss = 8.2833e-02, PNorm = 143.5386, GNorm = 2.3512, lr_0 = 9.9969e-04
Validation auc = 0.711462
Epoch 1014
Loss = 4.2122e-02, PNorm = 143.6337, GNorm = 0.6568, lr_0 = 9.9969e-04
Validation auc = 0.721942
Epoch 1015
Loss = 2.0277e-02, PNorm = 143.7418, GNorm = 0.8485, lr_0 = 9.9969e-04
Validation auc = 0.718472
Epoch 1016
Loss = 6.5987e-03, PNorm = 143.8457, GNorm = 0.4090, lr_0 = 9.9969e-04
Validation auc = 0.713693
Epoch 1017
Loss = 4.2027e-02, PNorm = 143.9501, GNorm = 0.8951, lr_0 = 9.9969e-04
Validation auc = 0.746104
Epoch 1018
Loss = 1.4564e-02, PNorm = 144.0471, GNorm = 0.5190, lr_0 = 9.9969e-04
Validation auc = 0.744470
Epoch 1019
Loss = 3.6158e-03, PNorm = 144.1247, GNorm = 0.1806, lr_0 = 9.9969e-04
Loss = 4.6781e-02, PNorm = 144.1897, GNorm = 2.0614, lr_0 = 9.9969e-04
Validation auc = 0.743273
Epoch 1020
Loss = 4.1405e-02, PNorm = 144.2829, GNorm = 1.6222, lr_0 = 9.9969e-04
Validation auc = 0.750987
Epoch 1021
Loss = 3.9683e-02, PNorm = 144.3764, GNorm = 2.0940, lr_0 = 9.9969e-04
Validation auc = 0.756574
Epoch 1022
Loss = 4.3471e-02, PNorm = 144.4763, GNorm = 0.1276, lr_0 = 9.9969e-04
Validation auc = 0.748181
Epoch 1023
Loss = 2.8845e-02, PNorm = 144.5682, GNorm = 1.7010, lr_0 = 9.9969e-04
Validation auc = 0.741269
Epoch 1024
Loss = 1.4392e-02, PNorm = 144.6501, GNorm = 0.1173, lr_0 = 9.9968e-04
Validation auc = 0.748188
Epoch 1025
Loss = 3.9787e-02, PNorm = 144.7308, GNorm = 0.2806, lr_0 = 9.9968e-04
Validation auc = 0.747750
Epoch 1026
Loss = 1.3439e-02, PNorm = 144.8044, GNorm = 0.1523, lr_0 = 9.9968e-04
Validation auc = 0.747413
Epoch 1027
Loss = 8.5007e-03, PNorm = 144.8664, GNorm = 0.0895, lr_0 = 9.9968e-04
Validation auc = 0.744792
Epoch 1028
Loss = 3.6586e-02, PNorm = 144.9184, GNorm = 1.0602, lr_0 = 9.9968e-04
Validation auc = 0.742760
Epoch 1029
Loss = 4.2108e-02, PNorm = 144.9916, GNorm = 0.9571, lr_0 = 9.9968e-04
Loss = 2.6385e-02, PNorm = 145.0583, GNorm = 1.1586, lr_0 = 9.9968e-04
Validation auc = 0.733334
Epoch 1030
Loss = 1.0679e-02, PNorm = 145.1295, GNorm = 0.5009, lr_0 = 9.9968e-04
Validation auc = 0.721979
Epoch 1031
Loss = 6.9767e-02, PNorm = 145.1985, GNorm = 3.2130, lr_0 = 9.9968e-04
Validation auc = 0.731042
Epoch 1032
Loss = 4.4980e-02, PNorm = 145.3495, GNorm = 0.4899, lr_0 = 9.9968e-04
Validation auc = 0.731783
Epoch 1033
Loss = 6.2361e-02, PNorm = 145.4907, GNorm = 0.9036, lr_0 = 9.9968e-04
Validation auc = 0.733028
Epoch 1034
Loss = 3.0420e-02, PNorm = 145.6122, GNorm = 1.0413, lr_0 = 9.9968e-04
Validation auc = 0.733713
Epoch 1035
Loss = 2.6997e-02, PNorm = 145.7116, GNorm = 0.7272, lr_0 = 9.9968e-04
Validation auc = 0.735245
Epoch 1036
Loss = 9.9783e-03, PNorm = 145.7864, GNorm = 0.0956, lr_0 = 9.9968e-04
Validation auc = 0.746212
Epoch 1037
Loss = 2.3275e-02, PNorm = 145.8580, GNorm = 0.1739, lr_0 = 9.9968e-04
Validation auc = 0.750382
Epoch 1038
Loss = 2.3040e-02, PNorm = 145.9489, GNorm = 0.8104, lr_0 = 9.9967e-04
Validation auc = 0.745690
Epoch 1039
Loss = 5.9728e-03, PNorm = 146.0390, GNorm = 0.3149, lr_0 = 9.9967e-04
Loss = 2.2596e-02, PNorm = 146.1460, GNorm = 0.0876, lr_0 = 9.9967e-04
Validation auc = 0.739772
Epoch 1040
Loss = 2.8932e-02, PNorm = 146.2345, GNorm = 0.2488, lr_0 = 9.9967e-04
Validation auc = 0.742361
Epoch 1041
Loss = 1.1851e-02, PNorm = 146.3176, GNorm = 0.0367, lr_0 = 9.9967e-04
Validation auc = 0.754177
Epoch 1042
Loss = 8.5427e-02, PNorm = 146.3926, GNorm = 1.6358, lr_0 = 9.9967e-04
Validation auc = 0.760872
Epoch 1043
Loss = 3.2789e-02, PNorm = 146.5142, GNorm = 0.3580, lr_0 = 9.9967e-04
Validation auc = 0.740523
Epoch 1044
Loss = 4.0250e-02, PNorm = 146.6372, GNorm = 1.2633, lr_0 = 9.9967e-04
Validation auc = 0.720739
Epoch 1045
Loss = 1.6134e-02, PNorm = 146.7498, GNorm = 1.9501, lr_0 = 9.9967e-04
Validation auc = 0.722385
Epoch 1046
Loss = 6.7726e-03, PNorm = 146.8612, GNorm = 0.0603, lr_0 = 9.9967e-04
Validation auc = 0.729971
Epoch 1047
Loss = 4.7634e-02, PNorm = 146.9951, GNorm = 2.1940, lr_0 = 9.9967e-04
Validation auc = 0.715711
Epoch 1048
Loss = 1.0047e-02, PNorm = 147.1703, GNorm = 1.2696, lr_0 = 9.9967e-04
Validation auc = 0.690597
Epoch 1049
Loss = 4.3959e-02, PNorm = 147.3386, GNorm = 0.9279, lr_0 = 9.9967e-04
Loss = 8.9791e-02, PNorm = 147.4645, GNorm = 1.1798, lr_0 = 9.9967e-04
Validation auc = 0.712741
Epoch 1050
Loss = 3.7227e-02, PNorm = 147.5932, GNorm = 0.3060, lr_0 = 9.9966e-04
Validation auc = 0.721222
Epoch 1051
Loss = 2.8889e-02, PNorm = 147.7009, GNorm = 1.1148, lr_0 = 9.9966e-04
Validation auc = 0.717215
Epoch 1052
Loss = 4.0910e-02, PNorm = 147.7888, GNorm = 0.2787, lr_0 = 9.9966e-04
Validation auc = 0.712978
Epoch 1053
Loss = 3.0618e-02, PNorm = 147.8536, GNorm = 1.3529, lr_0 = 9.9966e-04
Validation auc = 0.723657
Epoch 1054
Loss = 1.2858e-02, PNorm = 147.9171, GNorm = 0.0994, lr_0 = 9.9966e-04
Validation auc = 0.736277
Epoch 1055
Loss = 2.9133e-02, PNorm = 147.9844, GNorm = 0.3202, lr_0 = 9.9966e-04
Validation auc = 0.740938
Epoch 1056
Loss = 4.7732e-02, PNorm = 148.0457, GNorm = 0.9781, lr_0 = 9.9966e-04
Validation auc = 0.745028
Epoch 1057
Loss = 7.1174e-03, PNorm = 148.1351, GNorm = 0.1035, lr_0 = 9.9966e-04
Validation auc = 0.736334
Epoch 1058
Loss = 6.5744e-02, PNorm = 148.2177, GNorm = 1.9089, lr_0 = 9.9966e-04
Validation auc = 0.732991
Epoch 1059
Loss = 1.9063e-02, PNorm = 148.3281, GNorm = 0.7514, lr_0 = 9.9966e-04
Loss = 3.6705e-02, PNorm = 148.4003, GNorm = 1.2504, lr_0 = 9.9966e-04
Validation auc = 0.740162
Epoch 1060
Loss = 1.6159e-02, PNorm = 148.4792, GNorm = 0.2224, lr_0 = 9.9966e-04
Validation auc = 0.749253
Epoch 1061
Loss = 2.6432e-02, PNorm = 148.5560, GNorm = 0.0519, lr_0 = 9.9966e-04
Validation auc = 0.739640
Epoch 1062
Loss = 5.8926e-02, PNorm = 148.6380, GNorm = 0.1104, lr_0 = 9.9966e-04
Validation auc = 0.720208
Epoch 1063
Loss = 3.0899e-02, PNorm = 148.7347, GNorm = 0.1860, lr_0 = 9.9966e-04
Validation auc = 0.727151
Epoch 1064
Loss = 3.1830e-02, PNorm = 148.8039, GNorm = 0.3026, lr_0 = 9.9965e-04
Validation auc = 0.724643
Epoch 1065
Loss = 4.1387e-02, PNorm = 148.8645, GNorm = 1.0373, lr_0 = 9.9965e-04
Validation auc = 0.727741
Epoch 1066
Loss = 1.1403e-02, PNorm = 148.9254, GNorm = 0.2455, lr_0 = 9.9965e-04
Validation auc = 0.727103
Epoch 1067
Loss = 2.9907e-02, PNorm = 148.9932, GNorm = 0.6788, lr_0 = 9.9965e-04
Validation auc = 0.733369
Epoch 1068
Loss = 1.2309e-02, PNorm = 149.0528, GNorm = 0.4158, lr_0 = 9.9965e-04
Validation auc = 0.741789
Epoch 1069
Loss = 1.9409e-02, PNorm = 149.1205, GNorm = 0.9609, lr_0 = 9.9965e-04
Loss = 3.9300e-02, PNorm = 149.2007, GNorm = 0.2016, lr_0 = 9.9965e-04
Validation auc = 0.735231
Epoch 1070
Loss = 2.2545e-02, PNorm = 149.2849, GNorm = 0.8875, lr_0 = 9.9965e-04
Validation auc = 0.738266
Epoch 1071
Loss = 2.0916e-02, PNorm = 149.3450, GNorm = 1.2706, lr_0 = 9.9965e-04
Validation auc = 0.727732
Epoch 1072
Loss = 2.7370e-02, PNorm = 149.4002, GNorm = 0.1234, lr_0 = 9.9965e-04
Validation auc = 0.728199
Epoch 1073
Loss = 1.5536e-02, PNorm = 149.4825, GNorm = 0.5863, lr_0 = 9.9965e-04
Validation auc = 0.729818
Epoch 1074
Loss = 6.7488e-03, PNorm = 149.5665, GNorm = 0.1547, lr_0 = 9.9965e-04
Validation auc = 0.726642
Epoch 1075
Loss = 2.7171e-02, PNorm = 149.6518, GNorm = 0.7232, lr_0 = 9.9965e-04
Validation auc = 0.717910
Epoch 1076
Loss = 5.6458e-02, PNorm = 149.7308, GNorm = 1.4562, lr_0 = 9.9965e-04
Validation auc = 0.726311
Epoch 1077
Loss = 7.0411e-03, PNorm = 149.8064, GNorm = 0.0540, lr_0 = 9.9964e-04
Validation auc = 0.735727
Epoch 1078
Loss = 7.5895e-02, PNorm = 149.8880, GNorm = 0.8025, lr_0 = 9.9964e-04
Validation auc = 0.730405
Epoch 1079
Loss = 1.7373e-02, PNorm = 149.9730, GNorm = 0.3035, lr_0 = 9.9964e-04
Loss = 1.6140e-02, PNorm = 150.0546, GNorm = 0.1582, lr_0 = 9.9964e-04
Validation auc = 0.718672
Epoch 1080
Loss = 2.7075e-02, PNorm = 150.1331, GNorm = 0.1465, lr_0 = 9.9964e-04
Validation auc = 0.709955
Epoch 1081
Loss = 5.4097e-02, PNorm = 150.2110, GNorm = 0.7974, lr_0 = 9.9964e-04
Validation auc = 0.713551
Epoch 1082
Loss = 2.4357e-02, PNorm = 150.3138, GNorm = 0.0489, lr_0 = 9.9964e-04
Validation auc = 0.710432
Epoch 1083
Loss = 1.0828e-02, PNorm = 150.3803, GNorm = 0.1791, lr_0 = 9.9964e-04
Validation auc = 0.711052
Epoch 1084
Loss = 6.7677e-03, PNorm = 150.4424, GNorm = 0.1117, lr_0 = 9.9964e-04
Validation auc = 0.714900
Epoch 1085
Loss = 2.1844e-02, PNorm = 150.4945, GNorm = 1.0946, lr_0 = 9.9964e-04
Validation auc = 0.723018
Epoch 1086
Loss = 5.2712e-03, PNorm = 150.5691, GNorm = 0.2629, lr_0 = 9.9964e-04
Validation auc = 0.728681
Epoch 1087
Loss = 9.5430e-03, PNorm = 150.6362, GNorm = 0.2759, lr_0 = 9.9964e-04
Validation auc = 0.732754
Epoch 1088
Loss = 1.2526e-02, PNorm = 150.7047, GNorm = 0.2806, lr_0 = 9.9964e-04
Validation auc = 0.725430
Epoch 1089
Loss = 2.8929e-02, PNorm = 150.8106, GNorm = 0.9506, lr_0 = 9.9964e-04
Loss = 3.5860e-02, PNorm = 150.8977, GNorm = 1.3524, lr_0 = 9.9964e-04
Validation auc = 0.731960
Epoch 1090
Loss = 5.7193e-02, PNorm = 150.9880, GNorm = 1.2557, lr_0 = 9.9963e-04
Validation auc = 0.740365
Epoch 1091
Loss = 4.5593e-02, PNorm = 151.0709, GNorm = 0.8007, lr_0 = 9.9963e-04
Validation auc = 0.746764
Epoch 1092
Loss = 2.0684e-02, PNorm = 151.1617, GNorm = 0.7160, lr_0 = 9.9963e-04
Validation auc = 0.747269
Epoch 1093
Loss = 1.8735e-02, PNorm = 151.2346, GNorm = 1.3464, lr_0 = 9.9963e-04
Validation auc = 0.739098
Epoch 1094
Loss = 3.2723e-02, PNorm = 151.3332, GNorm = 0.9356, lr_0 = 9.9963e-04
Validation auc = 0.732486
Epoch 1095
Loss = 1.3777e-02, PNorm = 151.4205, GNorm = 0.5673, lr_0 = 9.9963e-04
Validation auc = 0.724708
Epoch 1096
Loss = 4.5690e-02, PNorm = 151.4990, GNorm = 1.0934, lr_0 = 9.9963e-04
Validation auc = 0.723820
Epoch 1097
Loss = 4.5875e-02, PNorm = 151.5851, GNorm = 1.3746, lr_0 = 9.9963e-04
Validation auc = 0.715571
Epoch 1098
Loss = 7.2462e-02, PNorm = 151.6616, GNorm = 0.2896, lr_0 = 9.9963e-04
Validation auc = 0.727703
Epoch 1099
Loss = 9.0256e-03, PNorm = 151.7733, GNorm = 0.3749, lr_0 = 9.9963e-04
Loss = 3.7677e-02, PNorm = 151.8761, GNorm = 2.5506, lr_0 = 9.9963e-04
Validation auc = 0.707108
Epoch 1100
Loss = 2.2608e-02, PNorm = 151.9803, GNorm = 1.3003, lr_0 = 9.9963e-04
Validation auc = 0.678366
Epoch 1101
Loss = 4.4756e-02, PNorm = 152.0761, GNorm = 1.8589, lr_0 = 9.9963e-04
Validation auc = 0.692573
Epoch 1102
Loss = 1.0241e-02, PNorm = 152.1761, GNorm = 0.2936, lr_0 = 9.9963e-04
Validation auc = 0.698364
Epoch 1103
Loss = 2.7816e-02, PNorm = 152.2517, GNorm = 0.0778, lr_0 = 9.9962e-04
Validation auc = 0.697087
Epoch 1104
Loss = 3.4608e-02, PNorm = 152.3477, GNorm = 0.2787, lr_0 = 9.9962e-04
Validation auc = 0.677632
Epoch 1105
Loss = 3.5081e-02, PNorm = 152.4359, GNorm = 0.5576, lr_0 = 9.9962e-04
Validation auc = 0.685092
Epoch 1106
Loss = 5.1008e-02, PNorm = 152.5078, GNorm = 0.1778, lr_0 = 9.9962e-04
Validation auc = 0.681712
Epoch 1107
Loss = 1.0569e-02, PNorm = 152.5796, GNorm = 0.3222, lr_0 = 9.9962e-04
Validation auc = 0.684735
Epoch 1108
Loss = 4.3061e-03, PNorm = 152.6496, GNorm = 0.0720, lr_0 = 9.9962e-04
Validation auc = 0.694693
Epoch 1109
Loss = 4.3321e-02, PNorm = 152.7202, GNorm = 0.8656, lr_0 = 9.9962e-04
Loss = 2.3251e-02, PNorm = 152.7938, GNorm = 0.8968, lr_0 = 9.9962e-04
Validation auc = 0.697020
Epoch 1110
Loss = 2.8025e-02, PNorm = 152.8820, GNorm = 0.3688, lr_0 = 9.9962e-04
Validation auc = 0.696640
Epoch 1111
Loss = 4.2414e-02, PNorm = 152.9662, GNorm = 0.6286, lr_0 = 9.9962e-04
Validation auc = 0.709572
Epoch 1112
Loss = 2.2584e-02, PNorm = 153.0495, GNorm = 0.7659, lr_0 = 9.9962e-04
Validation auc = 0.709667
Epoch 1113
Loss = 2.4440e-02, PNorm = 153.1226, GNorm = 0.1542, lr_0 = 9.9962e-04
Validation auc = 0.689867
Epoch 1114
Loss = 4.7519e-02, PNorm = 153.2130, GNorm = 1.6739, lr_0 = 9.9962e-04
Validation auc = 0.695590
Epoch 1115
Loss = 7.2833e-02, PNorm = 153.3174, GNorm = 1.9349, lr_0 = 9.9962e-04
Validation auc = 0.722826
Epoch 1116
Loss = 1.3736e-02, PNorm = 153.4565, GNorm = 0.6902, lr_0 = 9.9962e-04
Validation auc = 0.725062
Epoch 1117
Loss = 3.3281e-02, PNorm = 153.5800, GNorm = 1.0783, lr_0 = 9.9961e-04
Validation auc = 0.709308
Epoch 1118
Loss = 2.1765e-02, PNorm = 153.6845, GNorm = 1.2047, lr_0 = 9.9961e-04
Validation auc = 0.719622
Epoch 1119
Loss = 1.0023e-02, PNorm = 153.7886, GNorm = 0.5214, lr_0 = 9.9961e-04
Loss = 6.0081e-02, PNorm = 153.8708, GNorm = 0.8944, lr_0 = 9.9961e-04
Validation auc = 0.724565
Epoch 1120
Loss = 3.0709e-02, PNorm = 153.9655, GNorm = 0.2707, lr_0 = 9.9961e-04
Validation auc = 0.721187
Epoch 1121
Loss = 2.6369e-02, PNorm = 154.0712, GNorm = 1.0278, lr_0 = 9.9961e-04
Validation auc = 0.710673
Epoch 1122
Loss = 4.4100e-02, PNorm = 154.1599, GNorm = 0.2569, lr_0 = 9.9961e-04
Validation auc = 0.702594
Epoch 1123
Loss = 6.5823e-02, PNorm = 154.2575, GNorm = 0.9382, lr_0 = 9.9961e-04
Validation auc = 0.684011
Epoch 1124
Loss = 5.7917e-02, PNorm = 154.4019, GNorm = 2.3597, lr_0 = 9.9961e-04
Validation auc = 0.708290
Epoch 1125
Loss = 3.2346e-02, PNorm = 154.5698, GNorm = 0.5895, lr_0 = 9.9961e-04
Validation auc = 0.711312
Epoch 1126
Loss = 4.1783e-02, PNorm = 154.7091, GNorm = 1.1972, lr_0 = 9.9961e-04
Validation auc = 0.723210
Epoch 1127
Loss = 7.9664e-02, PNorm = 154.8017, GNorm = 1.9435, lr_0 = 9.9961e-04
Validation auc = 0.732976
Epoch 1128
Loss = 6.7483e-02, PNorm = 154.9258, GNorm = 1.7616, lr_0 = 9.9961e-04
Validation auc = 0.743783
Epoch 1129
Loss = 1.6800e-01, PNorm = 155.0437, GNorm = 1.3108, lr_0 = 9.9961e-04
Loss = 2.1383e-02, PNorm = 155.1407, GNorm = 0.5190, lr_0 = 9.9960e-04
Validation auc = 0.740627
Epoch 1130
Loss = 3.6462e-02, PNorm = 155.2461, GNorm = 1.1601, lr_0 = 9.9960e-04
Validation auc = 0.726027
Epoch 1131
Loss = 5.7653e-02, PNorm = 155.3367, GNorm = 3.8584, lr_0 = 9.9960e-04
Validation auc = 0.726337
Epoch 1132
Loss = 2.5043e-02, PNorm = 155.4807, GNorm = 0.9626, lr_0 = 9.9960e-04
Validation auc = 0.721718
Epoch 1133
Loss = 2.5592e-02, PNorm = 155.5923, GNorm = 0.5954, lr_0 = 9.9960e-04
Validation auc = 0.716445
Epoch 1134
Loss = 5.9456e-02, PNorm = 155.6943, GNorm = 3.4581, lr_0 = 9.9960e-04
Validation auc = 0.710070
Epoch 1135
Loss = 1.1114e-01, PNorm = 155.8100, GNorm = 0.9198, lr_0 = 9.9960e-04
Validation auc = 0.722166
Epoch 1136
Loss = 1.6293e-02, PNorm = 155.9166, GNorm = 0.2074, lr_0 = 9.9960e-04
Validation auc = 0.728552
Epoch 1137
Loss = 2.3620e-02, PNorm = 156.0151, GNorm = 0.9908, lr_0 = 9.9960e-04
Validation auc = 0.725443
Epoch 1138
Loss = 8.7507e-03, PNorm = 156.1094, GNorm = 0.2976, lr_0 = 9.9960e-04
Validation auc = 0.746823
Epoch 1139
Loss = 2.9597e-03, PNorm = 156.1943, GNorm = 0.0546, lr_0 = 9.9960e-04
Loss = 1.9670e-02, PNorm = 156.2748, GNorm = 1.6921, lr_0 = 9.9960e-04
Validation auc = 0.741957
Epoch 1140
Loss = 4.3157e-02, PNorm = 156.3699, GNorm = 0.6157, lr_0 = 9.9960e-04
Validation auc = 0.705114
Epoch 1141
Loss = 6.2658e-02, PNorm = 156.4806, GNorm = 2.5437, lr_0 = 9.9960e-04
Validation auc = 0.697931
Epoch 1142
Loss = 3.9250e-02, PNorm = 156.5856, GNorm = 0.6807, lr_0 = 9.9960e-04
Validation auc = 0.681604
Epoch 1143
Loss = 4.3902e-02, PNorm = 156.6784, GNorm = 2.1239, lr_0 = 9.9959e-04
Validation auc = 0.687676
Epoch 1144
Loss = 4.5951e-02, PNorm = 156.7601, GNorm = 1.3377, lr_0 = 9.9959e-04
Validation auc = 0.701387
Epoch 1145
Loss = 2.7531e-02, PNorm = 156.8363, GNorm = 0.0715, lr_0 = 9.9959e-04
Validation auc = 0.711514
Epoch 1146
Loss = 3.1786e-02, PNorm = 156.9104, GNorm = 0.5939, lr_0 = 9.9959e-04
Validation auc = 0.729036
Epoch 1147
Loss = 1.9613e-02, PNorm = 156.9920, GNorm = 0.0859, lr_0 = 9.9959e-04
Validation auc = 0.727895
Epoch 1148
Loss = 2.4952e-02, PNorm = 157.0786, GNorm = 1.1631, lr_0 = 9.9959e-04
Validation auc = 0.718502
Epoch 1149
Loss = 1.0840e-01, PNorm = 157.1898, GNorm = 0.8840, lr_0 = 9.9959e-04
Loss = 4.0092e-02, PNorm = 157.3212, GNorm = 1.4682, lr_0 = 9.9959e-04
Validation auc = 0.715445
Epoch 1150
Loss = 4.6402e-02, PNorm = 157.4299, GNorm = 2.4205, lr_0 = 9.9959e-04
Validation auc = 0.717458
Epoch 1151
Loss = 2.1882e-02, PNorm = 157.5397, GNorm = 0.2777, lr_0 = 9.9959e-04
Validation auc = 0.715704
Epoch 1152
Loss = 1.1989e-02, PNorm = 157.6283, GNorm = 0.7883, lr_0 = 9.9959e-04
Validation auc = 0.711374
Epoch 1153
Loss = 5.3392e-02, PNorm = 157.6908, GNorm = 4.1974, lr_0 = 9.9959e-04
Validation auc = 0.716987
Epoch 1154
Loss = 2.7411e-02, PNorm = 157.7750, GNorm = 1.3197, lr_0 = 9.9959e-04
Validation auc = 0.711730
Epoch 1155
Loss = 2.4518e-02, PNorm = 157.8690, GNorm = 0.2827, lr_0 = 9.9959e-04
Validation auc = 0.716297
Epoch 1156
Loss = 1.7298e-02, PNorm = 157.9815, GNorm = 0.1103, lr_0 = 9.9958e-04
Validation auc = 0.742251
Epoch 1157
Loss = 4.7675e-02, PNorm = 158.0957, GNorm = 3.7337, lr_0 = 9.9958e-04
Validation auc = 0.727354
Epoch 1158
Loss = 1.2933e-02, PNorm = 158.2192, GNorm = 0.2847, lr_0 = 9.9958e-04
Validation auc = 0.732283
Epoch 1159
Loss = 7.9967e-02, PNorm = 158.3595, GNorm = 1.0704, lr_0 = 9.9958e-04
Loss = 4.1617e-02, PNorm = 158.4820, GNorm = 0.1353, lr_0 = 9.9958e-04
Validation auc = 0.731718
Epoch 1160
Loss = 4.4952e-02, PNorm = 158.6055, GNorm = 1.3342, lr_0 = 9.9958e-04
Validation auc = 0.717064
Epoch 1161
Loss = 5.4815e-02, PNorm = 158.7343, GNorm = 1.0145, lr_0 = 9.9958e-04
Validation auc = 0.712351
Epoch 1162
Loss = 6.9999e-02, PNorm = 158.8380, GNorm = 0.4137, lr_0 = 9.9958e-04
Validation auc = 0.711474
Epoch 1163
Loss = 4.1645e-02, PNorm = 158.9410, GNorm = 0.4636, lr_0 = 9.9958e-04
Validation auc = 0.707766
Epoch 1164
Loss = 3.7018e-02, PNorm = 159.0518, GNorm = 0.7998, lr_0 = 9.9958e-04
Validation auc = 0.722743
Epoch 1165
Loss = 1.6697e-02, PNorm = 159.1469, GNorm = 1.0363, lr_0 = 9.9958e-04
Validation auc = 0.726908
Epoch 1166
Loss = 1.9124e-02, PNorm = 159.2461, GNorm = 1.0339, lr_0 = 9.9958e-04
Validation auc = 0.722438
Epoch 1167
Loss = 2.1089e-02, PNorm = 159.3255, GNorm = 0.8638, lr_0 = 9.9958e-04
Validation auc = 0.729710
Epoch 1168
Loss = 1.1999e-02, PNorm = 159.4189, GNorm = 0.0484, lr_0 = 9.9958e-04
Validation auc = 0.727143
Epoch 1169
Loss = 2.0939e-02, PNorm = 159.5130, GNorm = 0.8569, lr_0 = 9.9958e-04
Loss = 6.4441e-02, PNorm = 159.6142, GNorm = 0.9377, lr_0 = 9.9957e-04
Validation auc = 0.721390
Epoch 1170
Loss = 2.9358e-02, PNorm = 159.7039, GNorm = 0.0394, lr_0 = 9.9957e-04
Validation auc = 0.718987
Epoch 1171
Loss = 3.7859e-02, PNorm = 159.7858, GNorm = 0.0604, lr_0 = 9.9957e-04
Validation auc = 0.719360
Epoch 1172
Loss = 3.4480e-02, PNorm = 159.8905, GNorm = 0.2691, lr_0 = 9.9957e-04
Validation auc = 0.721139
Epoch 1173
Loss = 5.4939e-02, PNorm = 159.9949, GNorm = 1.5109, lr_0 = 9.9957e-04
Validation auc = 0.746325
Epoch 1174
Loss = 5.7879e-02, PNorm = 160.1193, GNorm = 0.5819, lr_0 = 9.9957e-04
Validation auc = 0.722172
Epoch 1175
Loss = 1.5008e-02, PNorm = 160.2123, GNorm = 0.2739, lr_0 = 9.9957e-04
Validation auc = 0.715309
Epoch 1176
Loss = 4.1004e-02, PNorm = 160.2856, GNorm = 0.3339, lr_0 = 9.9957e-04
Validation auc = 0.706955
Epoch 1177
Loss = 1.2198e-02, PNorm = 160.3699, GNorm = 0.0557, lr_0 = 9.9957e-04
Validation auc = 0.688151
Epoch 1178
Loss = 1.9024e-02, PNorm = 160.4771, GNorm = 1.8662, lr_0 = 9.9957e-04
Validation auc = 0.713800
Epoch 1179
Loss = 1.0257e-02, PNorm = 160.5883, GNorm = 0.3260, lr_0 = 9.9957e-04
Loss = 3.3388e-02, PNorm = 160.7117, GNorm = 0.1010, lr_0 = 9.9957e-04
Validation auc = 0.725506
Epoch 1180
Loss = 6.6907e-02, PNorm = 160.8206, GNorm = 0.6687, lr_0 = 9.9957e-04
Validation auc = 0.738346
Epoch 1181
Loss = 3.4807e-02, PNorm = 160.9247, GNorm = 1.7037, lr_0 = 9.9957e-04
Validation auc = 0.731424
Epoch 1182
Loss = 3.8701e-02, PNorm = 161.0264, GNorm = 1.1101, lr_0 = 9.9956e-04
Validation auc = 0.726380
Epoch 1183
Loss = 3.5291e-02, PNorm = 161.1240, GNorm = 0.0280, lr_0 = 9.9956e-04
Validation auc = 0.725196
Epoch 1184
Loss = 1.0015e-01, PNorm = 161.2268, GNorm = 0.9818, lr_0 = 9.9956e-04
Validation auc = 0.718951
Epoch 1185
Loss = 1.6968e-02, PNorm = 161.3214, GNorm = 0.8995, lr_0 = 9.9956e-04
Validation auc = 0.720565
Epoch 1186
Loss = 6.4627e-03, PNorm = 161.3941, GNorm = 0.2295, lr_0 = 9.9956e-04
Validation auc = 0.723101
Epoch 1187
Loss = 3.4488e-03, PNorm = 161.4665, GNorm = 0.1017, lr_0 = 9.9956e-04
Validation auc = 0.725896
Epoch 1188
Loss = 9.0643e-02, PNorm = 161.5570, GNorm = 1.1806, lr_0 = 9.9956e-04
Validation auc = 0.734668
Epoch 1189
Loss = 6.1822e-03, PNorm = 161.6568, GNorm = 0.1233, lr_0 = 9.9956e-04
Loss = 2.0645e-02, PNorm = 161.7765, GNorm = 0.0310, lr_0 = 9.9956e-04
Validation auc = 0.717278
Epoch 1190
Loss = 4.3995e-02, PNorm = 161.8607, GNorm = 0.0707, lr_0 = 9.9956e-04
Validation auc = 0.712594
Epoch 1191
Loss = 3.4397e-02, PNorm = 161.9292, GNorm = 0.0993, lr_0 = 9.9956e-04
Validation auc = 0.719439
Epoch 1192
Loss = 4.0780e-02, PNorm = 162.0045, GNorm = 1.2302, lr_0 = 9.9956e-04
Validation auc = 0.724660
Epoch 1193
Loss = 2.5267e-02, PNorm = 162.0725, GNorm = 1.3525, lr_0 = 9.9956e-04
Validation auc = 0.725318
Epoch 1194
Loss = 1.6119e-02, PNorm = 162.1450, GNorm = 0.3229, lr_0 = 9.9956e-04
Validation auc = 0.723542
Epoch 1195
Loss = 4.7535e-03, PNorm = 162.2062, GNorm = 0.0390, lr_0 = 9.9956e-04
Validation auc = 0.711004
Epoch 1196
Loss = 3.1393e-02, PNorm = 162.2584, GNorm = 0.5289, lr_0 = 9.9955e-04
Validation auc = 0.706677
Epoch 1197
Loss = 8.1065e-02, PNorm = 162.3121, GNorm = 0.7915, lr_0 = 9.9955e-04
Validation auc = 0.710703
Epoch 1198
Loss = 1.1561e-02, PNorm = 162.3619, GNorm = 0.0372, lr_0 = 9.9955e-04
Validation auc = 0.712411
Epoch 1199
Loss = 9.6926e-02, PNorm = 162.4141, GNorm = 1.3539, lr_0 = 9.9955e-04
Loss = 5.0332e-02, PNorm = 162.5203, GNorm = 3.0611, lr_0 = 9.9955e-04
Validation auc = 0.695680
Epoch 1200
Loss = 3.3439e-02, PNorm = 162.6551, GNorm = 0.3390, lr_0 = 9.9955e-04
Validation auc = 0.712790
Epoch 1201
Loss = 4.9652e-02, PNorm = 162.7818, GNorm = 0.6095, lr_0 = 9.9955e-04
Validation auc = 0.716707
Epoch 1202
Loss = 6.8609e-02, PNorm = 162.8830, GNorm = 1.0957, lr_0 = 9.9955e-04
Validation auc = 0.717026
Epoch 1203
Loss = 4.0852e-02, PNorm = 162.9869, GNorm = 0.1350, lr_0 = 9.9955e-04
Validation auc = 0.722504
Epoch 1204
Loss = 2.9400e-02, PNorm = 163.0688, GNorm = 0.4363, lr_0 = 9.9955e-04
Validation auc = 0.726566
Epoch 1205
Loss = 3.0637e-02, PNorm = 163.1365, GNorm = 0.4645, lr_0 = 9.9955e-04
Validation auc = 0.731064
Epoch 1206
Loss = 1.0810e-02, PNorm = 163.2004, GNorm = 0.0288, lr_0 = 9.9955e-04
Validation auc = 0.714115
Epoch 1207
Loss = 2.5517e-02, PNorm = 163.2726, GNorm = 2.0312, lr_0 = 9.9955e-04
Validation auc = 0.703856
Epoch 1208
Loss = 1.3967e-02, PNorm = 163.3607, GNorm = 0.3971, lr_0 = 9.9955e-04
Validation auc = 0.722778
Epoch 1209
Loss = 3.6460e-03, PNorm = 163.4664, GNorm = 0.1559, lr_0 = 9.9954e-04
Loss = 8.2261e-02, PNorm = 163.5878, GNorm = 1.9742, lr_0 = 9.9954e-04
Validation auc = 0.712019
Epoch 1210
Loss = 4.6116e-02, PNorm = 163.7341, GNorm = 3.6875, lr_0 = 9.9954e-04
Validation auc = 0.716865
Epoch 1211
Loss = 5.5917e-02, PNorm = 163.8742, GNorm = 2.0389, lr_0 = 9.9954e-04
Validation auc = 0.731657
Epoch 1212
Loss = 3.0662e-02, PNorm = 164.0102, GNorm = 0.1386, lr_0 = 9.9954e-04
Validation auc = 0.731197
Epoch 1213
Loss = 1.9550e-02, PNorm = 164.1202, GNorm = 0.1951, lr_0 = 9.9954e-04
Validation auc = 0.746685
Epoch 1214
Loss = 6.9240e-02, PNorm = 164.2246, GNorm = 0.3983, lr_0 = 9.9954e-04
Validation auc = 0.745066
Epoch 1215
Loss = 5.5359e-02, PNorm = 164.3407, GNorm = 0.4349, lr_0 = 9.9954e-04
Validation auc = 0.729959
Epoch 1216
Loss = 2.0517e-02, PNorm = 164.4552, GNorm = 0.4753, lr_0 = 9.9954e-04
Validation auc = 0.724831
Epoch 1217
Loss = 4.3394e-02, PNorm = 164.5721, GNorm = 0.8380, lr_0 = 9.9954e-04
Validation auc = 0.733451
Epoch 1218
Loss = 3.5093e-02, PNorm = 164.6824, GNorm = 1.1517, lr_0 = 9.9954e-04
Validation auc = 0.725406
Epoch 1219
Loss = 2.4557e-02, PNorm = 164.7903, GNorm = 0.8436, lr_0 = 9.9954e-04
Loss = 5.6527e-02, PNorm = 164.8900, GNorm = 0.5639, lr_0 = 9.9954e-04
Validation auc = 0.723753
Epoch 1220
Loss = 3.4261e-02, PNorm = 164.9813, GNorm = 0.2167, lr_0 = 9.9954e-04
Validation auc = 0.710512
Epoch 1221
Loss = 1.9052e-02, PNorm = 165.0593, GNorm = 0.9006, lr_0 = 9.9954e-04
Validation auc = 0.708822
Epoch 1222
Loss = 3.5485e-02, PNorm = 165.1344, GNorm = 0.5791, lr_0 = 9.9953e-04
Validation auc = 0.711740
Epoch 1223
Loss = 1.0823e-02, PNorm = 165.2304, GNorm = 0.5494, lr_0 = 9.9953e-04
Validation auc = 0.714894
Epoch 1224
Loss = 1.8600e-02, PNorm = 165.3070, GNorm = 1.7945, lr_0 = 9.9953e-04
Validation auc = 0.709148
Epoch 1225
Loss = 1.3253e-02, PNorm = 165.3690, GNorm = 0.6274, lr_0 = 9.9953e-04
Validation auc = 0.701628
Epoch 1226
Loss = 3.6300e-02, PNorm = 165.4363, GNorm = 0.7030, lr_0 = 9.9953e-04
Validation auc = 0.716919
Epoch 1227
Loss = 1.9579e-02, PNorm = 165.5288, GNorm = 0.3006, lr_0 = 9.9953e-04
Validation auc = 0.718874
Epoch 1228
Loss = 1.5009e-02, PNorm = 165.6163, GNorm = 0.6044, lr_0 = 9.9953e-04
Validation auc = 0.713887
Epoch 1229
Loss = 5.9322e-03, PNorm = 165.6862, GNorm = 0.2574, lr_0 = 9.9953e-04
Loss = 2.1170e-02, PNorm = 165.7519, GNorm = 1.4788, lr_0 = 9.9953e-04
Validation auc = 0.715903
Epoch 1230
Loss = 5.1450e-02, PNorm = 165.8190, GNorm = 1.1665, lr_0 = 9.9953e-04
Validation auc = 0.718232
Epoch 1231
Loss = 2.4704e-02, PNorm = 165.8938, GNorm = 2.4627, lr_0 = 9.9953e-04
Validation auc = 0.727390
Epoch 1232
Loss = 2.0068e-02, PNorm = 165.9668, GNorm = 0.1506, lr_0 = 9.9953e-04
Validation auc = 0.715624
Epoch 1233
Loss = 4.2722e-02, PNorm = 166.0392, GNorm = 2.3841, lr_0 = 9.9953e-04
Validation auc = 0.713664
Epoch 1234
Loss = 6.0862e-02, PNorm = 166.1304, GNorm = 0.0486, lr_0 = 9.9953e-04
Validation auc = 0.703372
Epoch 1235
Loss = 4.3780e-02, PNorm = 166.2318, GNorm = 1.5178, lr_0 = 9.9952e-04
Validation auc = 0.701074
Epoch 1236
Loss = 1.3550e-02, PNorm = 166.3261, GNorm = 0.5567, lr_0 = 9.9952e-04
Validation auc = 0.712979
Epoch 1237
Loss = 4.0841e-02, PNorm = 166.4003, GNorm = 0.2376, lr_0 = 9.9952e-04
Validation auc = 0.710951
Epoch 1238
Loss = 1.0745e-02, PNorm = 166.4822, GNorm = 0.8090, lr_0 = 9.9952e-04
Validation auc = 0.701946
Epoch 1239
Loss = 2.9045e-02, PNorm = 166.5674, GNorm = 1.1815, lr_0 = 9.9952e-04
Loss = 3.1938e-02, PNorm = 166.6521, GNorm = 0.3028, lr_0 = 9.9952e-04
Validation auc = 0.703741
Epoch 1240
Loss = 2.8604e-02, PNorm = 166.7541, GNorm = 1.8399, lr_0 = 9.9952e-04
Validation auc = 0.698593
Epoch 1241
Loss = 3.8119e-02, PNorm = 166.8664, GNorm = 0.7912, lr_0 = 9.9952e-04
Validation auc = 0.699218
Epoch 1242
Loss = 5.3030e-02, PNorm = 166.9649, GNorm = 0.8429, lr_0 = 9.9952e-04
Validation auc = 0.705098
Epoch 1243
Loss = 5.1186e-02, PNorm = 167.0620, GNorm = 0.6943, lr_0 = 9.9952e-04
Validation auc = 0.713605
Epoch 1244
Loss = 3.3523e-02, PNorm = 167.1350, GNorm = 0.2270, lr_0 = 9.9952e-04
Validation auc = 0.715349
Epoch 1245
Loss = 4.0241e-02, PNorm = 167.2038, GNorm = 0.5365, lr_0 = 9.9952e-04
Validation auc = 0.711089
Epoch 1246
Loss = 2.7144e-02, PNorm = 167.2734, GNorm = 0.6150, lr_0 = 9.9952e-04
Validation auc = 0.705197
Epoch 1247
Loss = 1.3652e-02, PNorm = 167.3508, GNorm = 1.7187, lr_0 = 9.9952e-04
Validation auc = 0.711272
Epoch 1248
Loss = 3.5700e-02, PNorm = 167.4398, GNorm = 0.3693, lr_0 = 9.9952e-04
Validation auc = 0.727473
Epoch 1249
Loss = 4.7435e-03, PNorm = 167.5305, GNorm = 0.4048, lr_0 = 9.9951e-04
Loss = 4.6303e-02, PNorm = 167.6464, GNorm = 1.3260, lr_0 = 9.9951e-04
Validation auc = 0.723192
Epoch 1250
Loss = 4.5905e-02, PNorm = 167.7672, GNorm = 0.7797, lr_0 = 9.9951e-04
Validation auc = 0.689526
Epoch 1251
Loss = 4.1546e-02, PNorm = 167.9014, GNorm = 1.5069, lr_0 = 9.9951e-04
Validation auc = 0.683179
Epoch 1252
Loss = 2.6223e-02, PNorm = 168.0119, GNorm = 0.1135, lr_0 = 9.9951e-04
Validation auc = 0.704943
Epoch 1253
Loss = 1.1069e-02, PNorm = 168.1042, GNorm = 0.4156, lr_0 = 9.9951e-04
Validation auc = 0.722509
Epoch 1254
Loss = 2.5388e-02, PNorm = 168.1790, GNorm = 2.0687, lr_0 = 9.9951e-04
Validation auc = 0.726052
Epoch 1255
Loss = 1.3903e-02, PNorm = 168.2408, GNorm = 1.2591, lr_0 = 9.9951e-04
Validation auc = 0.718759
Epoch 1256
Loss = 3.4136e-02, PNorm = 168.3255, GNorm = 0.0579, lr_0 = 9.9951e-04
Validation auc = 0.711165
Epoch 1257
Loss = 5.6011e-02, PNorm = 168.3995, GNorm = 0.1405, lr_0 = 9.9951e-04
Validation auc = 0.711343
Epoch 1258
Loss = 2.8117e-02, PNorm = 168.4583, GNorm = 1.2066, lr_0 = 9.9951e-04
Validation auc = 0.708526
Epoch 1259
Loss = 1.3214e-02, PNorm = 168.5311, GNorm = 0.4714, lr_0 = 9.9951e-04
Loss = 4.3637e-02, PNorm = 168.6154, GNorm = 1.9395, lr_0 = 9.9951e-04
Validation auc = 0.716235
Epoch 1260
Loss = 5.4992e-02, PNorm = 168.6964, GNorm = 0.1841, lr_0 = 9.9951e-04
Validation auc = 0.722548
Epoch 1261
Loss = 1.0236e-01, PNorm = 168.8159, GNorm = 0.6183, lr_0 = 9.9951e-04
Validation auc = 0.723583
Epoch 1262
Loss = 3.9008e-02, PNorm = 168.9402, GNorm = 0.6063, lr_0 = 9.9950e-04
Validation auc = 0.721190
Epoch 1263
Loss = 1.9054e-02, PNorm = 169.0345, GNorm = 0.7300, lr_0 = 9.9950e-04
Validation auc = 0.718308
Epoch 1264
Loss = 1.4604e-02, PNorm = 169.1007, GNorm = 0.6196, lr_0 = 9.9950e-04
Validation auc = 0.714426
Epoch 1265
Loss = 1.7680e-02, PNorm = 169.1551, GNorm = 0.3055, lr_0 = 9.9950e-04
Validation auc = 0.711980
Epoch 1266
Loss = 1.9422e-03, PNorm = 169.2042, GNorm = 0.1827, lr_0 = 9.9950e-04
Validation auc = 0.701723
Epoch 1267
Loss = 1.8846e-02, PNorm = 169.2544, GNorm = 0.9139, lr_0 = 9.9950e-04
Validation auc = 0.701512
Epoch 1268
Loss = 5.2361e-02, PNorm = 169.3149, GNorm = 1.2620, lr_0 = 9.9950e-04
Validation auc = 0.702736
Epoch 1269
Loss = 1.6070e-02, PNorm = 169.3861, GNorm = 1.1399, lr_0 = 9.9950e-04
Loss = 2.2938e-02, PNorm = 169.4754, GNorm = 0.0270, lr_0 = 9.9950e-04
Validation auc = 0.700072
Epoch 1270
Loss = 2.7137e-02, PNorm = 169.5520, GNorm = 1.4142, lr_0 = 9.9950e-04
Validation auc = 0.698221
Epoch 1271
Loss = 3.0857e-02, PNorm = 169.6211, GNorm = 0.9071, lr_0 = 9.9950e-04
Validation auc = 0.704862
Epoch 1272
Loss = 3.6537e-02, PNorm = 169.6955, GNorm = 1.4653, lr_0 = 9.9950e-04
Validation auc = 0.718115
Epoch 1273
Loss = 2.7464e-02, PNorm = 169.7524, GNorm = 0.3297, lr_0 = 9.9950e-04
Validation auc = 0.729259
Epoch 1274
Loss = 3.7843e-02, PNorm = 169.8197, GNorm = 0.2137, lr_0 = 9.9950e-04
Validation auc = 0.736890
Epoch 1275
Loss = 9.0806e-02, PNorm = 169.9018, GNorm = 1.6233, lr_0 = 9.9949e-04
Validation auc = 0.711989
Epoch 1276
Loss = 3.5241e-02, PNorm = 170.0068, GNorm = 0.3070, lr_0 = 9.9949e-04
Validation auc = 0.694468
Epoch 1277
Loss = 1.3794e-02, PNorm = 170.0960, GNorm = 0.6309, lr_0 = 9.9949e-04
Validation auc = 0.706902
Epoch 1278
Loss = 5.8424e-03, PNorm = 170.1688, GNorm = 0.2714, lr_0 = 9.9949e-04
Validation auc = 0.711266
Epoch 1279
Loss = 5.6576e-03, PNorm = 170.2227, GNorm = 0.2021, lr_0 = 9.9949e-04
Loss = 2.5278e-02, PNorm = 170.2838, GNorm = 0.9380, lr_0 = 9.9949e-04
Validation auc = 0.716027
Epoch 1280
Loss = 3.7327e-02, PNorm = 170.3723, GNorm = 2.0369, lr_0 = 9.9949e-04
Validation auc = 0.710239
Epoch 1281
Loss = 4.2527e-02, PNorm = 170.4914, GNorm = 0.1044, lr_0 = 9.9949e-04
Validation auc = 0.701908
Epoch 1282
Loss = 4.2748e-02, PNorm = 170.6123, GNorm = 0.1506, lr_0 = 9.9949e-04
Validation auc = 0.705118
Epoch 1283
Loss = 7.2253e-02, PNorm = 170.7264, GNorm = 1.3375, lr_0 = 9.9949e-04
Validation auc = 0.698022
Epoch 1284
Loss = 4.7760e-02, PNorm = 170.8325, GNorm = 0.3919, lr_0 = 9.9949e-04
Validation auc = 0.686307
Epoch 1285
Loss = 2.5684e-02, PNorm = 170.9208, GNorm = 0.2708, lr_0 = 9.9949e-04
Validation auc = 0.701400
Epoch 1286
Loss = 8.5658e-02, PNorm = 171.0143, GNorm = 4.8015, lr_0 = 9.9949e-04
Validation auc = 0.708154
Epoch 1287
Loss = 1.3184e-02, PNorm = 171.1287, GNorm = 0.5625, lr_0 = 9.9949e-04
Validation auc = 0.692623
Epoch 1288
Loss = 8.2364e-02, PNorm = 171.2329, GNorm = 2.9864, lr_0 = 9.9949e-04
Validation auc = 0.715755
Epoch 1289
Loss = 5.0825e-02, PNorm = 171.3500, GNorm = 1.5220, lr_0 = 9.9948e-04
Loss = 4.7938e-02, PNorm = 171.4893, GNorm = 1.2540, lr_0 = 9.9948e-04
Validation auc = 0.705070
Epoch 1290
Loss = 5.0595e-02, PNorm = 171.6027, GNorm = 0.0741, lr_0 = 9.9948e-04
Validation auc = 0.700344
Epoch 1291
Loss = 9.9332e-03, PNorm = 171.7012, GNorm = 0.1696, lr_0 = 9.9948e-04
Validation auc = 0.702882
Epoch 1292
Loss = 2.0804e-02, PNorm = 171.7712, GNorm = 0.0923, lr_0 = 9.9948e-04
Validation auc = 0.712474
Epoch 1293
Loss = 2.4878e-02, PNorm = 171.8431, GNorm = 0.0528, lr_0 = 9.9948e-04
Validation auc = 0.719008
Epoch 1294
Loss = 1.4016e-02, PNorm = 171.9116, GNorm = 0.4817, lr_0 = 9.9948e-04
Validation auc = 0.727886
Epoch 1295
Loss = 2.4294e-03, PNorm = 171.9750, GNorm = 0.2948, lr_0 = 9.9948e-04
Validation auc = 0.722683
Epoch 1296
Loss = 4.7423e-02, PNorm = 172.0396, GNorm = 2.3053, lr_0 = 9.9948e-04
Validation auc = 0.731472
Epoch 1297
Loss = 3.3731e-02, PNorm = 172.1525, GNorm = 1.3607, lr_0 = 9.9948e-04
Validation auc = 0.733486
Epoch 1298
Loss = 4.8939e-02, PNorm = 172.2553, GNorm = 1.1543, lr_0 = 9.9948e-04
Validation auc = 0.736657
Epoch 1299
Loss = 9.1764e-03, PNorm = 172.3440, GNorm = 0.2360, lr_0 = 9.9948e-04
Loss = 1.3170e-02, PNorm = 172.4151, GNorm = 1.4933, lr_0 = 9.9948e-04
Validation auc = 0.728789
Epoch 1300
Loss = 3.9130e-02, PNorm = 172.4877, GNorm = 0.4086, lr_0 = 9.9948e-04
Validation auc = 0.730244
Epoch 1301
Loss = 3.2199e-02, PNorm = 172.5670, GNorm = 0.0694, lr_0 = 9.9947e-04
Validation auc = 0.732941
Epoch 1302
Loss = 1.3652e-02, PNorm = 172.6339, GNorm = 1.4921, lr_0 = 9.9947e-04
Validation auc = 0.732561
Epoch 1303
Loss = 3.9551e-02, PNorm = 172.6995, GNorm = 2.5841, lr_0 = 9.9947e-04
Validation auc = 0.728349
Epoch 1304
Loss = 6.8973e-02, PNorm = 172.7736, GNorm = 1.5781, lr_0 = 9.9947e-04
Validation auc = 0.717307
Epoch 1305
Loss = 4.5080e-02, PNorm = 172.8701, GNorm = 0.7397, lr_0 = 9.9947e-04
Validation auc = 0.701083
Epoch 1306
Loss = 7.3502e-02, PNorm = 172.9734, GNorm = 1.4765, lr_0 = 9.9947e-04
Validation auc = 0.695744
Epoch 1307
Loss = 1.5517e-02, PNorm = 173.0621, GNorm = 0.3519, lr_0 = 9.9947e-04
Validation auc = 0.697117
Epoch 1308
Loss = 1.8637e-02, PNorm = 173.1462, GNorm = 1.1848, lr_0 = 9.9947e-04
Validation auc = 0.699165
Epoch 1309
Loss = 2.9182e-02, PNorm = 173.2168, GNorm = 1.3874, lr_0 = 9.9947e-04
Loss = 1.7437e-02, PNorm = 173.2870, GNorm = 0.0254, lr_0 = 9.9947e-04
Validation auc = 0.710639
Epoch 1310
Loss = 1.9783e-02, PNorm = 173.3536, GNorm = 0.9114, lr_0 = 9.9947e-04
Validation auc = 0.713295
Epoch 1311
Loss = 3.2219e-02, PNorm = 173.4309, GNorm = 0.1224, lr_0 = 9.9947e-04
Validation auc = 0.716028
Epoch 1312
Loss = 3.7507e-02, PNorm = 173.5223, GNorm = 0.9387, lr_0 = 9.9947e-04
Validation auc = 0.717973
Epoch 1313
Loss = 1.1976e-02, PNorm = 173.5982, GNorm = 0.0632, lr_0 = 9.9947e-04
Validation auc = 0.719343
Epoch 1314
Loss = 5.0458e-02, PNorm = 173.6844, GNorm = 1.1936, lr_0 = 9.9947e-04
Validation auc = 0.730103
Epoch 1315
Loss = 2.0368e-02, PNorm = 173.7669, GNorm = 0.1176, lr_0 = 9.9946e-04
Validation auc = 0.719731
Epoch 1316
Loss = 1.6372e-02, PNorm = 173.8571, GNorm = 0.1586, lr_0 = 9.9946e-04
Validation auc = 0.721765
Epoch 1317
Loss = 5.6100e-03, PNorm = 173.9335, GNorm = 0.0270, lr_0 = 9.9946e-04
Validation auc = 0.724335
Epoch 1318
Loss = 8.1127e-03, PNorm = 173.9896, GNorm = 0.1518, lr_0 = 9.9946e-04
Validation auc = 0.725718
Epoch 1319
Loss = 5.6721e-03, PNorm = 174.0298, GNorm = 0.3179, lr_0 = 9.9946e-04
Loss = 5.7340e-02, PNorm = 174.0867, GNorm = 3.2754, lr_0 = 9.9946e-04
Validation auc = 0.730913
Epoch 1320
Loss = 4.5743e-02, PNorm = 174.1922, GNorm = 0.3481, lr_0 = 9.9946e-04
Validation auc = 0.734549
Epoch 1321
Loss = 2.4466e-02, PNorm = 174.2963, GNorm = 1.4348, lr_0 = 9.9946e-04
Validation auc = 0.743423
Epoch 1322
Loss = 2.6406e-02, PNorm = 174.3875, GNorm = 1.7724, lr_0 = 9.9946e-04
Validation auc = 0.746354
Epoch 1323
Loss = 2.7176e-02, PNorm = 174.4635, GNorm = 0.7257, lr_0 = 9.9946e-04
Validation auc = 0.749955
Epoch 1324
Loss = 4.0068e-02, PNorm = 174.5309, GNorm = 0.6006, lr_0 = 9.9946e-04
Validation auc = 0.753076
Epoch 1325
Loss = 3.4028e-02, PNorm = 174.5845, GNorm = 0.1155, lr_0 = 9.9946e-04
Validation auc = 0.742747
Epoch 1326
Loss = 1.1529e-02, PNorm = 174.6365, GNorm = 0.4094, lr_0 = 9.9946e-04
Validation auc = 0.728446
Epoch 1327
Loss = 3.2397e-02, PNorm = 174.6960, GNorm = 0.5598, lr_0 = 9.9946e-04
Validation auc = 0.729584
Epoch 1328
Loss = 4.4935e-03, PNorm = 174.7715, GNorm = 0.3992, lr_0 = 9.9945e-04
Validation auc = 0.728816
Epoch 1329
Loss = 4.1056e-02, PNorm = 174.8457, GNorm = 1.3069, lr_0 = 9.9945e-04
Loss = 2.0370e-02, PNorm = 174.9154, GNorm = 0.9127, lr_0 = 9.9945e-04
Validation auc = 0.732417
Epoch 1330
Loss = 2.0373e-02, PNorm = 174.9804, GNorm = 1.7758, lr_0 = 9.9945e-04
Validation auc = 0.741407
Epoch 1331
Loss = 2.5372e-02, PNorm = 175.0751, GNorm = 0.6181, lr_0 = 9.9945e-04
Validation auc = 0.741499
Epoch 1332
Loss = 2.4949e-02, PNorm = 175.1714, GNorm = 0.3216, lr_0 = 9.9945e-04
Validation auc = 0.741919
Epoch 1333
Loss = 8.2760e-03, PNorm = 175.2524, GNorm = 0.4553, lr_0 = 9.9945e-04
Validation auc = 0.748453
Epoch 1334
Loss = 3.9448e-02, PNorm = 175.3462, GNorm = 0.8108, lr_0 = 9.9945e-04
Validation auc = 0.748995
Epoch 1335
Loss = 2.8567e-02, PNorm = 175.4483, GNorm = 1.7687, lr_0 = 9.9945e-04
Validation auc = 0.735425
Epoch 1336
Loss = 2.4337e-02, PNorm = 175.5346, GNorm = 0.2271, lr_0 = 9.9945e-04
Validation auc = 0.731663
Epoch 1337
Loss = 8.2767e-03, PNorm = 175.6050, GNorm = 0.7869, lr_0 = 9.9945e-04
Validation auc = 0.740803
Epoch 1338
Loss = 3.6208e-02, PNorm = 175.6814, GNorm = 0.9573, lr_0 = 9.9945e-04
Validation auc = 0.742787
Epoch 1339
Loss = 1.3250e-02, PNorm = 175.7769, GNorm = 0.4349, lr_0 = 9.9945e-04
Loss = 5.2545e-02, PNorm = 175.8757, GNorm = 0.1521, lr_0 = 9.9945e-04
Validation auc = 0.732801
Epoch 1340
Loss = 4.7780e-02, PNorm = 175.9933, GNorm = 1.1657, lr_0 = 9.9945e-04
Validation auc = 0.716115
Epoch 1341
Loss = 4.9889e-02, PNorm = 176.1055, GNorm = 1.1970, lr_0 = 9.9944e-04
Validation auc = 0.724755
Epoch 1342
Loss = 2.2668e-02, PNorm = 176.1997, GNorm = 0.9493, lr_0 = 9.9944e-04
Validation auc = 0.731199
Epoch 1343
Loss = 3.6533e-02, PNorm = 176.2810, GNorm = 0.1083, lr_0 = 9.9944e-04
Validation auc = 0.731978
Epoch 1344
Loss = 3.1918e-02, PNorm = 176.3613, GNorm = 0.3421, lr_0 = 9.9944e-04
Validation auc = 0.743507
Epoch 1345
Loss = 2.1033e-02, PNorm = 176.4526, GNorm = 1.4009, lr_0 = 9.9944e-04
Validation auc = 0.744718
Epoch 1346
Loss = 3.4435e-02, PNorm = 176.5480, GNorm = 2.3489, lr_0 = 9.9944e-04
Validation auc = 0.745954
Epoch 1347
Loss = 1.3630e-02, PNorm = 176.6446, GNorm = 0.0304, lr_0 = 9.9944e-04
Validation auc = 0.746194
Epoch 1348
Loss = 1.0509e-02, PNorm = 176.7489, GNorm = 1.0174, lr_0 = 9.9944e-04
Validation auc = 0.743861
Epoch 1349
Loss = 2.2296e-03, PNorm = 176.8453, GNorm = 0.0575, lr_0 = 9.9944e-04
Loss = 2.7310e-02, PNorm = 176.9223, GNorm = 1.0784, lr_0 = 9.9944e-04
Validation auc = 0.730862
Epoch 1350
Loss = 2.8311e-02, PNorm = 177.0084, GNorm = 1.4351, lr_0 = 9.9944e-04
Validation auc = 0.711752
Epoch 1351
Loss = 5.7054e-02, PNorm = 177.0788, GNorm = 0.0778, lr_0 = 9.9944e-04
Validation auc = 0.728699
Epoch 1352
Loss = 4.1109e-02, PNorm = 177.1527, GNorm = 0.7234, lr_0 = 9.9944e-04
Validation auc = 0.741401
Epoch 1353
Loss = 6.4446e-02, PNorm = 177.2257, GNorm = 0.1723, lr_0 = 9.9944e-04
Validation auc = 0.738965
Epoch 1354
Loss = 4.3187e-02, PNorm = 177.3222, GNorm = 0.5134, lr_0 = 9.9943e-04
Validation auc = 0.729551
Epoch 1355
Loss = 2.7785e-02, PNorm = 177.4201, GNorm = 1.1388, lr_0 = 9.9943e-04
Validation auc = 0.718473
Epoch 1356
Loss = 2.8979e-02, PNorm = 177.4939, GNorm = 0.5373, lr_0 = 9.9943e-04
Validation auc = 0.712330
Epoch 1357
Loss = 4.8802e-02, PNorm = 177.5590, GNorm = 0.8370, lr_0 = 9.9943e-04
Validation auc = 0.709900
Epoch 1358
Loss = 6.0056e-02, PNorm = 177.6295, GNorm = 0.2729, lr_0 = 9.9943e-04
Validation auc = 0.715053
Epoch 1359
Loss = 8.7529e-02, PNorm = 177.6814, GNorm = 0.5933, lr_0 = 9.9943e-04
Loss = 4.1125e-02, PNorm = 177.7254, GNorm = 0.0760, lr_0 = 9.9943e-04
Validation auc = 0.721812
Epoch 1360
Loss = 4.7289e-02, PNorm = 177.7892, GNorm = 1.1675, lr_0 = 9.9943e-04
Validation auc = 0.719069
Epoch 1361
Loss = 5.4532e-02, PNorm = 177.8588, GNorm = 1.1128, lr_0 = 9.9943e-04
Validation auc = 0.724904
Epoch 1362
Loss = 4.5459e-02, PNorm = 177.9575, GNorm = 0.7857, lr_0 = 9.9943e-04
Validation auc = 0.722280
Epoch 1363
Loss = 1.4414e-02, PNorm = 178.0561, GNorm = 0.4589, lr_0 = 9.9943e-04
Validation auc = 0.722692
Epoch 1364
Loss = 1.2088e-02, PNorm = 178.1384, GNorm = 0.5558, lr_0 = 9.9943e-04
Validation auc = 0.726546
Epoch 1365
Loss = 6.9235e-02, PNorm = 178.2098, GNorm = 1.2255, lr_0 = 9.9943e-04
Validation auc = 0.725717
Epoch 1366
Loss = 1.0307e-02, PNorm = 178.2950, GNorm = 0.1664, lr_0 = 9.9943e-04
Validation auc = 0.721775
Epoch 1367
Loss = 2.9746e-02, PNorm = 178.3734, GNorm = 0.5856, lr_0 = 9.9943e-04
Validation auc = 0.716248
Epoch 1368
Loss = 4.7170e-02, PNorm = 178.4409, GNorm = 2.1792, lr_0 = 9.9942e-04
Validation auc = 0.718789
Epoch 1369
Loss = 3.4533e-02, PNorm = 178.5226, GNorm = 1.7404, lr_0 = 9.9942e-04
Loss = 4.6644e-02, PNorm = 178.6115, GNorm = 1.0347, lr_0 = 9.9942e-04
Validation auc = 0.738278
Epoch 1370
Loss = 5.0166e-02, PNorm = 178.7105, GNorm = 0.9852, lr_0 = 9.9942e-04
Validation auc = 0.730661
Epoch 1371
Loss = 4.7737e-02, PNorm = 178.8135, GNorm = 1.0739, lr_0 = 9.9942e-04
Validation auc = 0.716283
Epoch 1372
Loss = 1.9325e-02, PNorm = 178.9050, GNorm = 0.1258, lr_0 = 9.9942e-04
Validation auc = 0.721623
Epoch 1373
Loss = 5.1106e-02, PNorm = 178.9733, GNorm = 0.4583, lr_0 = 9.9942e-04
Validation auc = 0.711594
Epoch 1374
Loss = 3.6392e-02, PNorm = 179.0342, GNorm = 0.5289, lr_0 = 9.9942e-04
Validation auc = 0.708620
Epoch 1375
Loss = 4.5189e-02, PNorm = 179.0950, GNorm = 0.8107, lr_0 = 9.9942e-04
Validation auc = 0.716318
Epoch 1376
Loss = 3.6251e-02, PNorm = 179.1484, GNorm = 0.9083, lr_0 = 9.9942e-04
Validation auc = 0.721965
Epoch 1377
Loss = 1.5579e-02, PNorm = 179.2256, GNorm = 0.5587, lr_0 = 9.9942e-04
Validation auc = 0.727172
Epoch 1378
Loss = 2.4069e-03, PNorm = 179.3161, GNorm = 0.1261, lr_0 = 9.9942e-04
Validation auc = 0.725522
Epoch 1379
Loss = 1.3827e-03, PNorm = 179.3848, GNorm = 0.0624, lr_0 = 9.9942e-04
Loss = 1.8129e-02, PNorm = 179.4537, GNorm = 1.7335, lr_0 = 9.9942e-04
Validation auc = 0.725418
Epoch 1380
Loss = 1.8529e-02, PNorm = 179.5215, GNorm = 3.2710, lr_0 = 9.9941e-04
Validation auc = 0.733292
Epoch 1381
Loss = 2.0010e-02, PNorm = 179.6098, GNorm = 0.9231, lr_0 = 9.9941e-04
Validation auc = 0.720576
Epoch 1382
Loss = 6.1976e-02, PNorm = 179.7097, GNorm = 0.0376, lr_0 = 9.9941e-04
Validation auc = 0.717488
Epoch 1383
Loss = 1.5551e-02, PNorm = 179.8151, GNorm = 0.0779, lr_0 = 9.9941e-04
Validation auc = 0.713767
Epoch 1384
Loss = 2.8592e-02, PNorm = 179.9082, GNorm = 0.3299, lr_0 = 9.9941e-04
Validation auc = 0.707608
Epoch 1385
Loss = 1.3024e-02, PNorm = 179.9944, GNorm = 0.4127, lr_0 = 9.9941e-04
Validation auc = 0.705998
Epoch 1386
Loss = 6.1723e-02, PNorm = 180.0598, GNorm = 0.1090, lr_0 = 9.9941e-04
Validation auc = 0.704215
Epoch 1387
Loss = 5.5224e-02, PNorm = 180.1299, GNorm = 0.2208, lr_0 = 9.9941e-04
Validation auc = 0.699336
Epoch 1388
Loss = 6.4547e-03, PNorm = 180.2111, GNorm = 0.7071, lr_0 = 9.9941e-04
Validation auc = 0.688036
Epoch 1389
Loss = 1.3400e-02, PNorm = 180.2925, GNorm = 0.4098, lr_0 = 9.9941e-04
Loss = 5.0716e-02, PNorm = 180.3611, GNorm = 0.8723, lr_0 = 9.9941e-04
Validation auc = 0.694684
Epoch 1390
Loss = 4.1892e-02, PNorm = 180.4403, GNorm = 1.1670, lr_0 = 9.9941e-04
Validation auc = 0.699631
Epoch 1391
Loss = 4.3786e-02, PNorm = 180.5170, GNorm = 0.1093, lr_0 = 9.9941e-04
Validation auc = 0.689887
Epoch 1392
Loss = 5.3288e-02, PNorm = 180.5949, GNorm = 0.4718, lr_0 = 9.9941e-04
Validation auc = 0.707878
Epoch 1393
Loss = 2.3192e-02, PNorm = 180.6644, GNorm = 0.1438, lr_0 = 9.9941e-04
Validation auc = 0.722051
Epoch 1394
Loss = 1.8905e-02, PNorm = 180.7496, GNorm = 0.0917, lr_0 = 9.9940e-04
Validation auc = 0.723815
Epoch 1395
Loss = 5.1313e-02, PNorm = 180.8343, GNorm = 1.8956, lr_0 = 9.9940e-04
Validation auc = 0.713039
Epoch 1396
Loss = 2.1128e-02, PNorm = 180.9274, GNorm = 0.7450, lr_0 = 9.9940e-04
Validation auc = 0.710030
Epoch 1397
Loss = 4.7417e-02, PNorm = 181.0182, GNorm = 1.1078, lr_0 = 9.9940e-04
Validation auc = 0.713688
Epoch 1398
Loss = 8.1333e-03, PNorm = 181.1054, GNorm = 0.1253, lr_0 = 9.9940e-04
Validation auc = 0.709544
Epoch 1399
Loss = 3.8265e-03, PNorm = 181.1819, GNorm = 0.2016, lr_0 = 9.9940e-04
Loss = 5.0962e-03, PNorm = 181.2491, GNorm = 0.0741, lr_0 = 9.9940e-04
Validation auc = 0.697688
Epoch 1400
Loss = 1.8877e-02, PNorm = 181.2830, GNorm = 0.0601, lr_0 = 9.9940e-04
Validation auc = 0.696927
Epoch 1401
Loss = 1.8368e-02, PNorm = 181.3232, GNorm = 0.1832, lr_0 = 9.9940e-04
Validation auc = 0.698769
Epoch 1402
Loss = 3.6922e-02, PNorm = 181.3938, GNorm = 0.6339, lr_0 = 9.9940e-04
Validation auc = 0.700526
Epoch 1403
Loss = 2.9642e-02, PNorm = 181.4704, GNorm = 0.0738, lr_0 = 9.9940e-04
Validation auc = 0.679303
Epoch 1404
Loss = 4.4552e-02, PNorm = 181.5556, GNorm = 0.2674, lr_0 = 9.9940e-04
Validation auc = 0.676811
Epoch 1405
Loss = 3.4322e-02, PNorm = 181.6422, GNorm = 0.6641, lr_0 = 9.9940e-04
Validation auc = 0.700316
Epoch 1406
Loss = 8.6231e-03, PNorm = 181.7233, GNorm = 0.2305, lr_0 = 9.9940e-04
Validation auc = 0.712415
Epoch 1407
Loss = 2.1046e-02, PNorm = 181.7982, GNorm = 2.0804, lr_0 = 9.9939e-04
Validation auc = 0.726029
Epoch 1408
Loss = 8.8576e-03, PNorm = 181.8997, GNorm = 0.5099, lr_0 = 9.9939e-04
Validation auc = 0.723487
Epoch 1409
Loss = 4.9202e-03, PNorm = 181.9854, GNorm = 0.2397, lr_0 = 9.9939e-04
Loss = 2.2710e-02, PNorm = 182.0482, GNorm = 0.4992, lr_0 = 9.9939e-04
Validation auc = 0.721712
Epoch 1410
Loss = 3.3518e-02, PNorm = 182.1425, GNorm = 0.3521, lr_0 = 9.9939e-04
Validation auc = 0.707543
Epoch 1411
Loss = 3.4844e-02, PNorm = 182.2522, GNorm = 3.8752, lr_0 = 9.9939e-04
Validation auc = 0.702097
Epoch 1412
Loss = 1.9794e-02, PNorm = 182.3650, GNorm = 0.3515, lr_0 = 9.9939e-04
Validation auc = 0.693439
Epoch 1413
Loss = 4.3117e-02, PNorm = 182.4685, GNorm = 0.1602, lr_0 = 9.9939e-04
Validation auc = 0.697515
Epoch 1414
Loss = 3.9197e-02, PNorm = 182.5579, GNorm = 0.6094, lr_0 = 9.9939e-04
Validation auc = 0.687533
Epoch 1415
Loss = 9.6213e-03, PNorm = 182.6399, GNorm = 0.5184, lr_0 = 9.9939e-04
Validation auc = 0.685472
Epoch 1416
Loss = 2.0414e-02, PNorm = 182.7064, GNorm = 0.2650, lr_0 = 9.9939e-04
Validation auc = 0.683938
Epoch 1417
Loss = 1.3959e-02, PNorm = 182.7850, GNorm = 0.2437, lr_0 = 9.9939e-04
Validation auc = 0.684227
Epoch 1418
Loss = 1.4435e-02, PNorm = 182.8966, GNorm = 0.3905, lr_0 = 9.9939e-04
Validation auc = 0.698704
Epoch 1419
Loss = 4.0846e-02, PNorm = 183.0160, GNorm = 1.6228, lr_0 = 9.9939e-04
Loss = 1.9364e-02, PNorm = 183.1080, GNorm = 0.4985, lr_0 = 9.9939e-04
Validation auc = 0.706436
Epoch 1420
Loss = 2.9824e-02, PNorm = 183.2064, GNorm = 1.4490, lr_0 = 9.9938e-04
Validation auc = 0.695761
Epoch 1421
Loss = 4.2176e-02, PNorm = 183.3253, GNorm = 0.2503, lr_0 = 9.9938e-04
Validation auc = 0.688872
Epoch 1422
Loss = 4.5578e-02, PNorm = 183.4094, GNorm = 0.2638, lr_0 = 9.9938e-04
Validation auc = 0.698186
Epoch 1423
Loss = 5.5530e-02, PNorm = 183.5186, GNorm = 0.9856, lr_0 = 9.9938e-04
Validation auc = 0.719424
Epoch 1424
Loss = 7.1639e-02, PNorm = 183.6423, GNorm = 2.9861, lr_0 = 9.9938e-04
Validation auc = 0.730416
Epoch 1425
Loss = 7.0774e-02, PNorm = 183.7774, GNorm = 0.5951, lr_0 = 9.9938e-04
Validation auc = 0.729337
Epoch 1426
Loss = 3.6665e-02, PNorm = 183.9030, GNorm = 0.5841, lr_0 = 9.9938e-04
Validation auc = 0.723506
Epoch 1427
Loss = 1.3498e-02, PNorm = 184.0205, GNorm = 0.0565, lr_0 = 9.9938e-04
Validation auc = 0.719466
Epoch 1428
Loss = 1.9097e-02, PNorm = 184.1146, GNorm = 0.8260, lr_0 = 9.9938e-04
Validation auc = 0.724946
Epoch 1429
Loss = 3.3862e-02, PNorm = 184.2134, GNorm = 0.9412, lr_0 = 9.9938e-04
Loss = 4.3784e-02, PNorm = 184.3067, GNorm = 0.7914, lr_0 = 9.9938e-04
Validation auc = 0.721013
Epoch 1430
Loss = 2.8116e-02, PNorm = 184.3921, GNorm = 0.0622, lr_0 = 9.9938e-04
Validation auc = 0.724528
Epoch 1431
Loss = 2.0131e-02, PNorm = 184.4872, GNorm = 0.5790, lr_0 = 9.9938e-04
Validation auc = 0.728590
Epoch 1432
Loss = 3.4534e-02, PNorm = 184.5838, GNorm = 1.4759, lr_0 = 9.9938e-04
Validation auc = 0.727463
Epoch 1433
Loss = 2.5352e-02, PNorm = 184.6720, GNorm = 1.4072, lr_0 = 9.9937e-04
Validation auc = 0.706264
Epoch 1434
Loss = 1.5333e-02, PNorm = 184.7537, GNorm = 0.2037, lr_0 = 9.9937e-04
Validation auc = 0.707839
Epoch 1435
Loss = 3.9162e-02, PNorm = 184.8241, GNorm = 1.7568, lr_0 = 9.9937e-04
Validation auc = 0.713927
Epoch 1436
Loss = 2.9929e-02, PNorm = 184.8925, GNorm = 1.0167, lr_0 = 9.9937e-04
Validation auc = 0.694243
Epoch 1437
Loss = 8.4368e-02, PNorm = 184.9595, GNorm = 1.4703, lr_0 = 9.9937e-04
Validation auc = 0.688962
Epoch 1438
Loss = 2.7422e-02, PNorm = 185.0751, GNorm = 0.3704, lr_0 = 9.9937e-04
Validation auc = 0.712353
Epoch 1439
Loss = 3.3524e-03, PNorm = 185.2107, GNorm = 0.0956, lr_0 = 9.9937e-04
Loss = 3.2468e-02, PNorm = 185.3795, GNorm = 0.3749, lr_0 = 9.9937e-04
Validation auc = 0.719023
Epoch 1440
Loss = 4.4320e-02, PNorm = 185.4823, GNorm = 1.5541, lr_0 = 9.9937e-04
Validation auc = 0.715525
Epoch 1441
Loss = 2.7303e-02, PNorm = 185.5693, GNorm = 0.1997, lr_0 = 9.9937e-04
Validation auc = 0.704208
Epoch 1442
Loss = 1.1095e-02, PNorm = 185.6297, GNorm = 0.0222, lr_0 = 9.9937e-04
Validation auc = 0.707293
Epoch 1443
Loss = 2.7620e-02, PNorm = 185.6829, GNorm = 1.3675, lr_0 = 9.9937e-04
Validation auc = 0.705797
Epoch 1444
Loss = 3.1956e-02, PNorm = 185.7331, GNorm = 0.0790, lr_0 = 9.9937e-04
Validation auc = 0.709479
Epoch 1445
Loss = 3.9398e-02, PNorm = 185.7800, GNorm = 1.1531, lr_0 = 9.9937e-04
Validation auc = 0.709753
Epoch 1446
Loss = 2.4250e-02, PNorm = 185.8464, GNorm = 0.3439, lr_0 = 9.9937e-04
Validation auc = 0.722256
Epoch 1447
Loss = 4.5985e-03, PNorm = 185.9205, GNorm = 0.0885, lr_0 = 9.9936e-04
Validation auc = 0.724293
Epoch 1448
Loss = 2.0376e-02, PNorm = 185.9917, GNorm = 0.0825, lr_0 = 9.9936e-04
Validation auc = 0.720542
Epoch 1449
Loss = 1.4779e-02, PNorm = 186.0617, GNorm = 1.0096, lr_0 = 9.9936e-04
Loss = 6.3447e-02, PNorm = 186.1293, GNorm = 2.6839, lr_0 = 9.9936e-04
Validation auc = 0.705156
Epoch 1450
Loss = 3.1256e-02, PNorm = 186.2142, GNorm = 0.0330, lr_0 = 9.9936e-04
Validation auc = 0.715172
Epoch 1451
Loss = 1.7105e-02, PNorm = 186.3081, GNorm = 0.1125, lr_0 = 9.9936e-04
Validation auc = 0.722906
Epoch 1452
Loss = 2.2289e-02, PNorm = 186.3766, GNorm = 0.8208, lr_0 = 9.9936e-04
Validation auc = 0.720643
Epoch 1453
Loss = 3.0359e-02, PNorm = 186.4373, GNorm = 1.4222, lr_0 = 9.9936e-04
Validation auc = 0.710627
Epoch 1454
Loss = 2.4181e-02, PNorm = 186.5107, GNorm = 0.6549, lr_0 = 9.9936e-04
Validation auc = 0.710145
Epoch 1455
Loss = 1.9020e-02, PNorm = 186.6014, GNorm = 1.0600, lr_0 = 9.9936e-04
Validation auc = 0.702930
Epoch 1456
Loss = 1.0543e-02, PNorm = 186.6834, GNorm = 1.3227, lr_0 = 9.9936e-04
Validation auc = 0.704126
Epoch 1457
Loss = 4.7274e-02, PNorm = 186.7723, GNorm = 0.6890, lr_0 = 9.9936e-04
Validation auc = 0.713651
Epoch 1458
Loss = 2.3106e-02, PNorm = 186.8391, GNorm = 1.8597, lr_0 = 9.9936e-04
Validation auc = 0.701812
Epoch 1459
Loss = 5.2591e-03, PNorm = 186.8926, GNorm = 0.3467, lr_0 = 9.9936e-04
Loss = 3.9528e-02, PNorm = 186.9838, GNorm = 0.9121, lr_0 = 9.9936e-04
Validation auc = 0.700157
Epoch 1460
Loss = 3.3242e-02, PNorm = 187.0656, GNorm = 0.0406, lr_0 = 9.9935e-04
Validation auc = 0.713709
Epoch 1461
Loss = 2.6306e-02, PNorm = 187.1398, GNorm = 0.0810, lr_0 = 9.9935e-04
Validation auc = 0.716910
Epoch 1462
Loss = 3.8844e-02, PNorm = 187.2105, GNorm = 0.4765, lr_0 = 9.9935e-04
Validation auc = 0.713285
Epoch 1463
Loss = 4.8013e-02, PNorm = 187.2869, GNorm = 0.4051, lr_0 = 9.9935e-04
Validation auc = 0.708762
Epoch 1464
Loss = 1.9404e-02, PNorm = 187.3564, GNorm = 0.0897, lr_0 = 9.9935e-04
Validation auc = 0.710409
Epoch 1465
Loss = 8.7036e-03, PNorm = 187.4128, GNorm = 0.0368, lr_0 = 9.9935e-04
Validation auc = 0.712227
Epoch 1466
Loss = 4.4709e-02, PNorm = 187.4646, GNorm = 0.5634, lr_0 = 9.9935e-04
Validation auc = 0.707031
Epoch 1467
Loss = 2.8176e-02, PNorm = 187.5120, GNorm = 1.7792, lr_0 = 9.9935e-04
Validation auc = 0.713325
Epoch 1468
Loss = 4.2707e-03, PNorm = 187.5625, GNorm = 0.3675, lr_0 = 9.9935e-04
Validation auc = 0.716126
Epoch 1469
Loss = 8.5100e-02, PNorm = 187.6002, GNorm = 2.7409, lr_0 = 9.9935e-04
Loss = 2.3021e-02, PNorm = 187.6497, GNorm = 0.0116, lr_0 = 9.9935e-04
Validation auc = 0.697729
Epoch 1470
Loss = 4.7832e-02, PNorm = 187.7262, GNorm = 0.4253, lr_0 = 9.9935e-04
Validation auc = 0.695466
Epoch 1471
Loss = 3.4304e-02, PNorm = 187.8164, GNorm = 0.1014, lr_0 = 9.9935e-04
Validation auc = 0.704543
Epoch 1472
Loss = 5.4835e-02, PNorm = 187.9073, GNorm = 0.6854, lr_0 = 9.9935e-04
Validation auc = 0.708030
Epoch 1473
Loss = 8.3601e-02, PNorm = 187.9878, GNorm = 1.0343, lr_0 = 9.9934e-04
Validation auc = 0.722933
Epoch 1474
Loss = 6.0978e-02, PNorm = 188.0782, GNorm = 0.4451, lr_0 = 9.9934e-04
Validation auc = 0.734807
Epoch 1475
Loss = 2.5435e-02, PNorm = 188.1575, GNorm = 0.4885, lr_0 = 9.9934e-04
Validation auc = 0.739544
Epoch 1476
Loss = 4.0843e-02, PNorm = 188.2289, GNorm = 0.0774, lr_0 = 9.9934e-04
Validation auc = 0.734615
Epoch 1477
Loss = 6.0688e-02, PNorm = 188.2900, GNorm = 1.9857, lr_0 = 9.9934e-04
Validation auc = 0.723787
Epoch 1478
Loss = 1.3665e-03, PNorm = 188.3712, GNorm = 0.0229, lr_0 = 9.9934e-04
Validation auc = 0.708195
Epoch 1479
Loss = 1.0848e-02, PNorm = 188.4455, GNorm = 0.5102, lr_0 = 9.9934e-04
Loss = 4.3633e-02, PNorm = 188.5083, GNorm = 0.2827, lr_0 = 9.9934e-04
Validation auc = 0.701730
Epoch 1480
Loss = 1.5350e-02, PNorm = 188.5774, GNorm = 1.0412, lr_0 = 9.9934e-04
Validation auc = 0.702547
Epoch 1481
Loss = 2.9125e-02, PNorm = 188.6419, GNorm = 1.3460, lr_0 = 9.9934e-04
Validation auc = 0.695276
Epoch 1482
Loss = 5.4138e-02, PNorm = 188.7126, GNorm = 0.0627, lr_0 = 9.9934e-04
Validation auc = 0.697876
Epoch 1483
Loss = 2.8496e-02, PNorm = 188.7892, GNorm = 0.8601, lr_0 = 9.9934e-04
Validation auc = 0.685802
Epoch 1484
Loss = 4.2615e-02, PNorm = 188.8772, GNorm = 0.1737, lr_0 = 9.9934e-04
Validation auc = 0.686815
Epoch 1485
Loss = 4.0806e-02, PNorm = 188.9825, GNorm = 0.8265, lr_0 = 9.9934e-04
Validation auc = 0.682176
Epoch 1486
Loss = 4.7575e-02, PNorm = 189.0722, GNorm = 1.5406, lr_0 = 9.9934e-04
Validation auc = 0.688643
Epoch 1487
Loss = 1.9369e-02, PNorm = 189.1459, GNorm = 0.0632, lr_0 = 9.9933e-04
Validation auc = 0.700135
Epoch 1488
Loss = 3.8186e-02, PNorm = 189.2046, GNorm = 1.2487, lr_0 = 9.9933e-04
Validation auc = 0.699682
Epoch 1489
Loss = 6.8845e-02, PNorm = 189.2648, GNorm = 1.0670, lr_0 = 9.9933e-04
Loss = 4.0975e-02, PNorm = 189.3487, GNorm = 0.9694, lr_0 = 9.9933e-04
Validation auc = 0.714255
Epoch 1490
Loss = 3.0962e-02, PNorm = 189.4401, GNorm = 0.8945, lr_0 = 9.9933e-04
Validation auc = 0.707580
Epoch 1491
Loss = 2.5144e-02, PNorm = 189.5144, GNorm = 0.2211, lr_0 = 9.9933e-04
Validation auc = 0.709386
Epoch 1492
Loss = 1.3812e-02, PNorm = 189.5822, GNorm = 0.1309, lr_0 = 9.9933e-04
Validation auc = 0.701435
Epoch 1493
Loss = 6.7044e-02, PNorm = 189.6275, GNorm = 0.6904, lr_0 = 9.9933e-04
Validation auc = 0.701634
Epoch 1494
Loss = 2.2921e-02, PNorm = 189.6634, GNorm = 0.2870, lr_0 = 9.9933e-04
Validation auc = 0.702472
Epoch 1495
Loss = 1.1224e-02, PNorm = 189.7204, GNorm = 0.1001, lr_0 = 9.9933e-04
Validation auc = 0.713768
Epoch 1496
Loss = 7.9207e-02, PNorm = 189.7886, GNorm = 0.1065, lr_0 = 9.9933e-04
Validation auc = 0.712856
Epoch 1497
Loss = 5.0990e-02, PNorm = 189.8474, GNorm = 1.3062, lr_0 = 9.9933e-04
Validation auc = 0.702154
Epoch 1498
Loss = 3.0059e-02, PNorm = 189.9051, GNorm = 1.5749, lr_0 = 9.9933e-04
Validation auc = 0.702532
Epoch 1499
Loss = 4.9758e-03, PNorm = 189.9740, GNorm = 0.1657, lr_0 = 9.9933e-04
Loss = 2.0757e-02, PNorm = 190.0290, GNorm = 0.1851, lr_0 = 9.9932e-04
Validation auc = 0.707142
Epoch 1500
Loss = 1.9395e-02, PNorm = 190.0921, GNorm = 1.6812, lr_0 = 9.9932e-04
Validation auc = 0.711340
Epoch 1501
Loss = 4.1546e-02, PNorm = 190.1699, GNorm = 4.2519, lr_0 = 9.9932e-04
Validation auc = 0.713382
Epoch 1502
Loss = 4.7182e-02, PNorm = 190.2813, GNorm = 1.6189, lr_0 = 9.9932e-04
Validation auc = 0.724634
Epoch 1503
Loss = 1.6242e-02, PNorm = 190.3970, GNorm = 1.3351, lr_0 = 9.9932e-04
Validation auc = 0.717069
Epoch 1504
Loss = 2.2903e-02, PNorm = 190.5016, GNorm = 1.0187, lr_0 = 9.9932e-04
Validation auc = 0.703534
Epoch 1505
Loss = 1.2228e-02, PNorm = 190.6257, GNorm = 0.1846, lr_0 = 9.9932e-04
Validation auc = 0.697392
Epoch 1506
Loss = 1.6516e-02, PNorm = 190.7400, GNorm = 0.8057, lr_0 = 9.9932e-04
Validation auc = 0.686346
Epoch 1507
Loss = 1.6619e-02, PNorm = 190.8605, GNorm = 0.0995, lr_0 = 9.9932e-04
Validation auc = 0.689690
Epoch 1508
Loss = 6.3630e-03, PNorm = 190.9624, GNorm = 0.3689, lr_0 = 9.9932e-04
Validation auc = 0.688278
Epoch 1509
Loss = 1.4309e-02, PNorm = 191.0689, GNorm = 0.6334, lr_0 = 9.9932e-04
Loss = 6.5301e-02, PNorm = 191.1924, GNorm = 0.9197, lr_0 = 9.9932e-04
Validation auc = 0.714270
Epoch 1510
Loss = 6.3614e-02, PNorm = 191.3108, GNorm = 0.3238, lr_0 = 9.9932e-04
Validation auc = 0.715024
Epoch 1511
Loss = 1.9324e-02, PNorm = 191.4145, GNorm = 0.2214, lr_0 = 9.9932e-04
Validation auc = 0.709342
Epoch 1512
Loss = 2.8208e-02, PNorm = 191.5035, GNorm = 0.5845, lr_0 = 9.9932e-04
Validation auc = 0.703906
Epoch 1513
Loss = 3.0627e-02, PNorm = 191.5916, GNorm = 0.1854, lr_0 = 9.9931e-04
Validation auc = 0.702866
Epoch 1514
Loss = 4.2345e-02, PNorm = 191.6697, GNorm = 1.0291, lr_0 = 9.9931e-04
Validation auc = 0.707955
Epoch 1515
Loss = 3.6209e-02, PNorm = 191.7499, GNorm = 1.4248, lr_0 = 9.9931e-04
Validation auc = 0.709765
Epoch 1516
Loss = 2.3127e-02, PNorm = 191.8292, GNorm = 0.0865, lr_0 = 9.9931e-04
Validation auc = 0.702439
Epoch 1517
Loss = 1.1425e-01, PNorm = 191.8965, GNorm = 1.0829, lr_0 = 9.9931e-04
Validation auc = 0.698419
Epoch 1518
Loss = 1.0877e-02, PNorm = 191.9708, GNorm = 0.7126, lr_0 = 9.9931e-04
Validation auc = 0.700594
Epoch 1519
Loss = 9.2098e-03, PNorm = 192.0385, GNorm = 0.4702, lr_0 = 9.9931e-04
Loss = 1.9067e-02, PNorm = 192.1114, GNorm = 0.3639, lr_0 = 9.9931e-04
Validation auc = 0.713810
Epoch 1520
Loss = 2.9950e-02, PNorm = 192.1934, GNorm = 0.5607, lr_0 = 9.9931e-04
Validation auc = 0.708643
Epoch 1521
Loss = 2.4323e-02, PNorm = 192.2933, GNorm = 1.1922, lr_0 = 9.9931e-04
Validation auc = 0.699829
Epoch 1522
Loss = 1.7344e-02, PNorm = 192.3978, GNorm = 0.4054, lr_0 = 9.9931e-04
Validation auc = 0.702455
Epoch 1523
Loss = 2.7810e-02, PNorm = 192.4939, GNorm = 0.9343, lr_0 = 9.9931e-04
Validation auc = 0.711399
Epoch 1524
Loss = 7.2845e-02, PNorm = 192.5799, GNorm = 1.3075, lr_0 = 9.9931e-04
Validation auc = 0.721884
Epoch 1525
Loss = 2.2477e-02, PNorm = 192.6708, GNorm = 0.8377, lr_0 = 9.9931e-04
Validation auc = 0.729715
Epoch 1526
Loss = 2.5100e-02, PNorm = 192.7507, GNorm = 1.0039, lr_0 = 9.9930e-04
Validation auc = 0.733778
Epoch 1527
Loss = 1.8404e-02, PNorm = 192.8161, GNorm = 0.1464, lr_0 = 9.9930e-04
Validation auc = 0.730499
Epoch 1528
Loss = 3.2857e-03, PNorm = 192.8688, GNorm = 0.1815, lr_0 = 9.9930e-04
Validation auc = 0.720955
Epoch 1529
Loss = 1.2206e-03, PNorm = 192.9195, GNorm = 0.0825, lr_0 = 9.9930e-04
Loss = 4.9585e-02, PNorm = 192.9807, GNorm = 0.0575, lr_0 = 9.9930e-04
Validation auc = 0.710219
Epoch 1530
Loss = 3.1870e-02, PNorm = 193.0617, GNorm = 0.1961, lr_0 = 9.9930e-04
Validation auc = 0.715783
Epoch 1531
Loss = 2.3393e-02, PNorm = 193.1427, GNorm = 1.1209, lr_0 = 9.9930e-04
Validation auc = 0.723756
Epoch 1532
Loss = 4.0421e-02, PNorm = 193.2130, GNorm = 0.0516, lr_0 = 9.9930e-04
Validation auc = 0.715847
Epoch 1533
Loss = 1.0234e-02, PNorm = 193.2821, GNorm = 0.1101, lr_0 = 9.9930e-04
Validation auc = 0.724793
Epoch 1534
Loss = 1.0762e-02, PNorm = 193.3445, GNorm = 0.3816, lr_0 = 9.9930e-04
Validation auc = 0.723304
Epoch 1535
Loss = 5.8216e-02, PNorm = 193.4095, GNorm = 2.8153, lr_0 = 9.9930e-04
Validation auc = 0.735802
Epoch 1536
Loss = 5.6877e-02, PNorm = 193.4837, GNorm = 0.7428, lr_0 = 9.9930e-04
Validation auc = 0.752133
Epoch 1537
Loss = 1.0517e-02, PNorm = 193.5802, GNorm = 0.1438, lr_0 = 9.9930e-04
Validation auc = 0.758122
Epoch 1538
Loss = 5.6736e-02, PNorm = 193.6822, GNorm = 0.2915, lr_0 = 9.9930e-04
Validation auc = 0.755659
Epoch 1539
Loss = 2.1355e-02, PNorm = 193.7792, GNorm = 0.8373, lr_0 = 9.9930e-04
Loss = 3.7253e-02, PNorm = 193.8554, GNorm = 0.9595, lr_0 = 9.9929e-04
Validation auc = 0.750921
Epoch 1540
Loss = 3.2127e-02, PNorm = 193.9290, GNorm = 0.5615, lr_0 = 9.9929e-04
Validation auc = 0.747368
Epoch 1541
Loss = 5.8123e-02, PNorm = 194.0130, GNorm = 0.7233, lr_0 = 9.9929e-04
Validation auc = 0.742756
Epoch 1542
Loss = 3.7284e-02, PNorm = 194.1043, GNorm = 2.0839, lr_0 = 9.9929e-04
Validation auc = 0.744159
Epoch 1543
Loss = 1.3249e-02, PNorm = 194.1810, GNorm = 1.3045, lr_0 = 9.9929e-04
Validation auc = 0.744011
Epoch 1544
Loss = 6.0040e-02, PNorm = 194.2446, GNorm = 1.0182, lr_0 = 9.9929e-04
Validation auc = 0.740176
Epoch 1545
Loss = 2.3377e-02, PNorm = 194.3061, GNorm = 0.0500, lr_0 = 9.9929e-04
Validation auc = 0.737479
Epoch 1546
Loss = 9.9256e-03, PNorm = 194.3637, GNorm = 0.2302, lr_0 = 9.9929e-04
Validation auc = 0.744976
Epoch 1547
Loss = 3.1339e-02, PNorm = 194.4325, GNorm = 0.9049, lr_0 = 9.9929e-04
Validation auc = 0.739341
Epoch 1548
Loss = 1.3174e-02, PNorm = 194.5045, GNorm = 0.2200, lr_0 = 9.9929e-04
Validation auc = 0.726945
Epoch 1549
Loss = 2.4218e-02, PNorm = 194.5714, GNorm = 1.0793, lr_0 = 9.9929e-04
Loss = 6.3281e-03, PNorm = 194.6320, GNorm = 0.1216, lr_0 = 9.9929e-04
Validation auc = 0.722902
Epoch 1550
Loss = 2.7653e-02, PNorm = 194.6853, GNorm = 0.0752, lr_0 = 9.9929e-04
Validation auc = 0.717355
Epoch 1551
Loss = 1.6324e-02, PNorm = 194.7360, GNorm = 0.3735, lr_0 = 9.9929e-04
Validation auc = 0.713437
Epoch 1552
Loss = 2.5665e-02, PNorm = 194.7791, GNorm = 1.8053, lr_0 = 9.9928e-04
Validation auc = 0.721092
Epoch 1553
Loss = 3.7780e-02, PNorm = 194.8505, GNorm = 0.9931, lr_0 = 9.9928e-04
Validation auc = 0.729877
Epoch 1554
Loss = 1.8401e-02, PNorm = 194.9230, GNorm = 0.9207, lr_0 = 9.9928e-04
Validation auc = 0.727373
Epoch 1555
Loss = 1.1456e-02, PNorm = 194.9896, GNorm = 0.0860, lr_0 = 9.9928e-04
Validation auc = 0.725127
Epoch 1556
Loss = 4.0528e-02, PNorm = 195.0560, GNorm = 2.4848, lr_0 = 9.9928e-04
Validation auc = 0.724219
Epoch 1557
Loss = 5.8761e-03, PNorm = 195.1502, GNorm = 0.6086, lr_0 = 9.9928e-04
Validation auc = 0.715577
Epoch 1558
Loss = 5.0949e-03, PNorm = 195.2557, GNorm = 0.0154, lr_0 = 9.9928e-04
Validation auc = 0.697328
Epoch 1559
Loss = 1.0856e-02, PNorm = 195.3659, GNorm = 0.3761, lr_0 = 9.9928e-04
Loss = 2.1513e-02, PNorm = 195.4817, GNorm = 1.3729, lr_0 = 9.9928e-04
Validation auc = 0.696726
Epoch 1560
Loss = 4.0995e-02, PNorm = 195.5872, GNorm = 3.2188, lr_0 = 9.9928e-04
Validation auc = 0.703106
Epoch 1561
Loss = 3.1275e-02, PNorm = 195.6741, GNorm = 1.3610, lr_0 = 9.9928e-04
Validation auc = 0.701179
Epoch 1562
Loss = 1.6939e-02, PNorm = 195.7781, GNorm = 0.1868, lr_0 = 9.9928e-04
Validation auc = 0.714312
Epoch 1563
Loss = 2.9160e-02, PNorm = 195.8821, GNorm = 0.1587, lr_0 = 9.9928e-04
Validation auc = 0.719478
Epoch 1564
Loss = 2.0455e-02, PNorm = 195.9638, GNorm = 0.7770, lr_0 = 9.9928e-04
Validation auc = 0.724870
Epoch 1565
Loss = 2.0105e-02, PNorm = 196.0373, GNorm = 1.1371, lr_0 = 9.9928e-04
Validation auc = 0.725746
Epoch 1566
Loss = 6.1316e-02, PNorm = 196.1112, GNorm = 0.4532, lr_0 = 9.9927e-04
Validation auc = 0.714341
Epoch 1567
Loss = 7.6518e-03, PNorm = 196.1789, GNorm = 0.1482, lr_0 = 9.9927e-04
Validation auc = 0.707341
Epoch 1568
Loss = 9.9419e-02, PNorm = 196.2373, GNorm = 2.3403, lr_0 = 9.9927e-04
Validation auc = 0.726951
Epoch 1569
Loss = 6.0490e-02, PNorm = 196.3138, GNorm = 1.0400, lr_0 = 9.9927e-04
Loss = 1.7255e-02, PNorm = 196.4008, GNorm = 0.2029, lr_0 = 9.9927e-04
Validation auc = 0.726685
Epoch 1570
Loss = 1.5589e-02, PNorm = 196.4746, GNorm = 0.3024, lr_0 = 9.9927e-04
Validation auc = 0.726951
Epoch 1571
Loss = 2.2338e-02, PNorm = 196.5263, GNorm = 0.0905, lr_0 = 9.9927e-04
Validation auc = 0.733594
Epoch 1572
Loss = 2.4122e-02, PNorm = 196.5840, GNorm = 0.4674, lr_0 = 9.9927e-04
Validation auc = 0.737752
Epoch 1573
Loss = 2.9430e-02, PNorm = 196.6499, GNorm = 0.3731, lr_0 = 9.9927e-04
Validation auc = 0.735925
Epoch 1574
Loss = 2.6098e-02, PNorm = 196.7151, GNorm = 0.6309, lr_0 = 9.9927e-04
Validation auc = 0.715802
Epoch 1575
Loss = 1.0278e-02, PNorm = 196.7869, GNorm = 0.3732, lr_0 = 9.9927e-04
Validation auc = 0.708698
Epoch 1576
Loss = 2.8870e-02, PNorm = 196.8502, GNorm = 1.6884, lr_0 = 9.9927e-04
Validation auc = 0.711877
Epoch 1577
Loss = 8.1597e-02, PNorm = 196.9044, GNorm = 1.2940, lr_0 = 9.9927e-04
Validation auc = 0.713217
Epoch 1578
Loss = 4.2538e-02, PNorm = 196.9443, GNorm = 1.2772, lr_0 = 9.9927e-04
Validation auc = 0.715074
Epoch 1579
Loss = 1.1074e-02, PNorm = 197.0038, GNorm = 0.4100, lr_0 = 9.9926e-04
Loss = 2.9104e-02, PNorm = 197.0642, GNorm = 1.0042, lr_0 = 9.9926e-04
Validation auc = 0.713467
Epoch 1580
Loss = 2.5773e-02, PNorm = 197.1265, GNorm = 1.8227, lr_0 = 9.9926e-04
Validation auc = 0.714634
Epoch 1581
Loss = 1.0858e-02, PNorm = 197.1855, GNorm = 0.0287, lr_0 = 9.9926e-04
Validation auc = 0.719753
Epoch 1582
Loss = 1.2756e-02, PNorm = 197.2402, GNorm = 0.0242, lr_0 = 9.9926e-04
Validation auc = 0.718881
Epoch 1583
Loss = 4.2021e-03, PNorm = 197.2925, GNorm = 0.3909, lr_0 = 9.9926e-04
Validation auc = 0.718596
Epoch 1584
Loss = 2.2902e-02, PNorm = 197.3620, GNorm = 0.2044, lr_0 = 9.9926e-04
Validation auc = 0.718084
Epoch 1585
Loss = 2.8762e-02, PNorm = 197.4539, GNorm = 1.8281, lr_0 = 9.9926e-04
Validation auc = 0.723862
Epoch 1586
Loss = 1.0228e-02, PNorm = 197.5654, GNorm = 0.6487, lr_0 = 9.9926e-04
Validation auc = 0.727992
Epoch 1587
Loss = 8.0168e-02, PNorm = 197.6473, GNorm = 0.7000, lr_0 = 9.9926e-04
Validation auc = 0.724336
Epoch 1588
Loss = 3.2758e-02, PNorm = 197.7213, GNorm = 0.9197, lr_0 = 9.9926e-04
Validation auc = 0.714624
Epoch 1589
Loss = 7.3286e-03, PNorm = 197.8067, GNorm = 0.3687, lr_0 = 9.9926e-04
Loss = 4.4825e-02, PNorm = 197.8709, GNorm = 1.0923, lr_0 = 9.9926e-04
Validation auc = 0.716679
Epoch 1590
Loss = 4.3237e-02, PNorm = 197.9330, GNorm = 0.6524, lr_0 = 9.9926e-04
Validation auc = 0.709564
Epoch 1591
Loss = 4.7173e-02, PNorm = 198.0252, GNorm = 1.3155, lr_0 = 9.9926e-04
Validation auc = 0.710996
Epoch 1592
Loss = 2.8551e-02, PNorm = 198.1194, GNorm = 0.7008, lr_0 = 9.9925e-04
Validation auc = 0.709685
Epoch 1593
Loss = 4.2970e-02, PNorm = 198.2119, GNorm = 0.5045, lr_0 = 9.9925e-04
Validation auc = 0.706092
Epoch 1594
Loss = 3.2340e-02, PNorm = 198.3009, GNorm = 1.5341, lr_0 = 9.9925e-04
Validation auc = 0.706138
Epoch 1595
Loss = 6.1397e-03, PNorm = 198.3657, GNorm = 0.6278, lr_0 = 9.9925e-04
Validation auc = 0.703361
Epoch 1596
Loss = 5.7760e-02, PNorm = 198.4161, GNorm = 0.6501, lr_0 = 9.9925e-04
Validation auc = 0.702742
Epoch 1597
Loss = 3.1092e-02, PNorm = 198.4752, GNorm = 0.9497, lr_0 = 9.9925e-04
Validation auc = 0.707330
Epoch 1598
Loss = 1.0433e-02, PNorm = 198.5498, GNorm = 0.2150, lr_0 = 9.9925e-04
Validation auc = 0.717356
Epoch 1599
Loss = 6.7196e-02, PNorm = 198.6169, GNorm = 1.2827, lr_0 = 9.9925e-04
Loss = 6.6519e-03, PNorm = 198.6760, GNorm = 0.3865, lr_0 = 9.9925e-04
Validation auc = 0.713214
Epoch 1600
Loss = 1.9423e-02, PNorm = 198.7448, GNorm = 0.2214, lr_0 = 9.9925e-04
Validation auc = 0.713861
Epoch 1601
Loss = 3.1040e-02, PNorm = 198.8149, GNorm = 1.0060, lr_0 = 9.9925e-04
Validation auc = 0.707136
Epoch 1602
Loss = 4.0024e-02, PNorm = 198.8907, GNorm = 0.9372, lr_0 = 9.9925e-04
Validation auc = 0.691476
Epoch 1603
Loss = 4.0055e-02, PNorm = 198.9603, GNorm = 0.2131, lr_0 = 9.9925e-04
Validation auc = 0.692771
Epoch 1604
Loss = 2.1955e-02, PNorm = 199.0265, GNorm = 1.2203, lr_0 = 9.9925e-04
Validation auc = 0.692263
Epoch 1605
Loss = 2.4307e-02, PNorm = 199.0909, GNorm = 0.4204, lr_0 = 9.9924e-04
Validation auc = 0.689490
Epoch 1606
Loss = 6.6486e-03, PNorm = 199.1436, GNorm = 0.0778, lr_0 = 9.9924e-04
Validation auc = 0.685661
Epoch 1607
Loss = 1.1104e-01, PNorm = 199.1875, GNorm = 0.2069, lr_0 = 9.9924e-04
Validation auc = 0.688186
Epoch 1608
Loss = 7.3384e-02, PNorm = 199.2466, GNorm = 0.4228, lr_0 = 9.9924e-04
Validation auc = 0.696006
Epoch 1609
Loss = 5.5216e-02, PNorm = 199.3330, GNorm = 1.0300, lr_0 = 9.9924e-04
Loss = 1.8465e-02, PNorm = 199.4172, GNorm = 2.4424, lr_0 = 9.9924e-04
Validation auc = 0.686750
Epoch 1610
Loss = 1.7141e-02, PNorm = 199.4776, GNorm = 0.0196, lr_0 = 9.9924e-04
Validation auc = 0.681471
Epoch 1611
Loss = 3.3896e-02, PNorm = 199.5487, GNorm = 0.8435, lr_0 = 9.9924e-04
Validation auc = 0.689972
Epoch 1612
Loss = 5.3292e-02, PNorm = 199.6121, GNorm = 0.4470, lr_0 = 9.9924e-04
Validation auc = 0.726448
Epoch 1613
Loss = 4.6250e-02, PNorm = 199.6882, GNorm = 1.3768, lr_0 = 9.9924e-04
Validation auc = 0.731052
Epoch 1614
Loss = 1.2154e-02, PNorm = 199.7631, GNorm = 0.0899, lr_0 = 9.9924e-04
Validation auc = 0.726450
Epoch 1615
Loss = 8.3279e-03, PNorm = 199.8311, GNorm = 0.6563, lr_0 = 9.9924e-04
Validation auc = 0.715684
Epoch 1616
Loss = 3.8665e-02, PNorm = 199.8953, GNorm = 1.0001, lr_0 = 9.9924e-04
Validation auc = 0.703842
Epoch 1617
Loss = 1.1171e-02, PNorm = 199.9623, GNorm = 0.2189, lr_0 = 9.9924e-04
Validation auc = 0.702932
Epoch 1618
Loss = 1.3378e-01, PNorm = 200.0271, GNorm = 1.5804, lr_0 = 9.9924e-04
Validation auc = 0.713386
Epoch 1619
Loss = 1.8652e-02, PNorm = 200.0885, GNorm = 0.7614, lr_0 = 9.9923e-04
Loss = 1.8119e-02, PNorm = 200.1469, GNorm = 0.1132, lr_0 = 9.9923e-04
Validation auc = 0.709799
Epoch 1620
Loss = 2.4318e-02, PNorm = 200.1964, GNorm = 0.1672, lr_0 = 9.9923e-04
Validation auc = 0.717091
Epoch 1621
Loss = 2.1145e-02, PNorm = 200.2489, GNorm = 0.4621, lr_0 = 9.9923e-04
Validation auc = 0.718315
Epoch 1622
Loss = 2.4742e-02, PNorm = 200.3199, GNorm = 0.0618, lr_0 = 9.9923e-04
Validation auc = 0.717343
Epoch 1623
Loss = 4.1784e-02, PNorm = 200.3819, GNorm = 1.0508, lr_0 = 9.9923e-04
Validation auc = 0.733124
Epoch 1624
Loss = 3.3069e-02, PNorm = 200.4823, GNorm = 0.6938, lr_0 = 9.9923e-04
Validation auc = 0.735686
Epoch 1625
Loss = 1.3622e-02, PNorm = 200.5693, GNorm = 0.9958, lr_0 = 9.9923e-04
Validation auc = 0.732416
Epoch 1626
Loss = 3.9132e-03, PNorm = 200.6254, GNorm = 0.0165, lr_0 = 9.9923e-04
Validation auc = 0.734966
Epoch 1627
Loss = 1.6735e-02, PNorm = 200.6795, GNorm = 0.9701, lr_0 = 9.9923e-04
Validation auc = 0.732315
Epoch 1628
Loss = 3.0722e-02, PNorm = 200.7286, GNorm = 0.2834, lr_0 = 9.9923e-04
Validation auc = 0.732937
Epoch 1629
Loss = 1.9847e-03, PNorm = 200.7757, GNorm = 0.0553, lr_0 = 9.9923e-04
Loss = 2.5938e-02, PNorm = 200.8178, GNorm = 1.7336, lr_0 = 9.9923e-04
Validation auc = 0.735254
Epoch 1630
Loss = 2.4736e-02, PNorm = 200.8792, GNorm = 1.0230, lr_0 = 9.9923e-04
Validation auc = 0.741149
Epoch 1631
Loss = 2.3881e-02, PNorm = 200.9437, GNorm = 0.0349, lr_0 = 9.9922e-04
Validation auc = 0.740932
Epoch 1632
Loss = 1.7695e-02, PNorm = 200.9965, GNorm = 1.9122, lr_0 = 9.9922e-04
Validation auc = 0.731703
Epoch 1633
Loss = 5.5914e-02, PNorm = 201.0544, GNorm = 1.7238, lr_0 = 9.9922e-04
Validation auc = 0.730081
Epoch 1634
Loss = 2.9267e-02, PNorm = 201.1389, GNorm = 2.5848, lr_0 = 9.9922e-04
Validation auc = 0.724753
Epoch 1635
Loss = 2.8776e-02, PNorm = 201.2415, GNorm = 0.1499, lr_0 = 9.9922e-04
Validation auc = 0.729490
Epoch 1636
Loss = 7.9374e-02, PNorm = 201.3375, GNorm = 0.1536, lr_0 = 9.9922e-04
Validation auc = 0.705228
Epoch 1637
Loss = 1.6313e-02, PNorm = 201.4461, GNorm = 0.0817, lr_0 = 9.9922e-04
Validation auc = 0.703093
Epoch 1638
Loss = 1.4754e-02, PNorm = 201.5338, GNorm = 0.4570, lr_0 = 9.9922e-04
Validation auc = 0.699270
Epoch 1639
Loss = 7.2499e-03, PNorm = 201.5931, GNorm = 0.2523, lr_0 = 9.9922e-04
Loss = 2.4030e-02, PNorm = 201.6546, GNorm = 0.3603, lr_0 = 9.9922e-04
Validation auc = 0.698585
Epoch 1640
Loss = 3.1139e-02, PNorm = 201.7160, GNorm = 1.1235, lr_0 = 9.9922e-04
Validation auc = 0.692530
Epoch 1641
Loss = 2.6307e-02, PNorm = 201.7831, GNorm = 0.0673, lr_0 = 9.9922e-04
Validation auc = 0.699512
Epoch 1642
Loss = 3.1290e-02, PNorm = 201.8367, GNorm = 0.0774, lr_0 = 9.9922e-04
Validation auc = 0.705083
Epoch 1643
Loss = 3.6841e-02, PNorm = 201.8875, GNorm = 2.2772, lr_0 = 9.9922e-04
Validation auc = 0.703042
Epoch 1644
Loss = 2.7111e-02, PNorm = 201.9514, GNorm = 0.1234, lr_0 = 9.9922e-04
Validation auc = 0.701326
Epoch 1645
Loss = 2.7578e-02, PNorm = 202.0075, GNorm = 0.4410, lr_0 = 9.9921e-04
Validation auc = 0.701147
Epoch 1646
Loss = 4.2720e-02, PNorm = 202.0659, GNorm = 0.0979, lr_0 = 9.9921e-04
Validation auc = 0.693910
Epoch 1647
Loss = 3.9258e-02, PNorm = 202.1306, GNorm = 0.7368, lr_0 = 9.9921e-04
Validation auc = 0.688127
Epoch 1648
Loss = 2.9576e-02, PNorm = 202.2007, GNorm = 0.5144, lr_0 = 9.9921e-04
Validation auc = 0.686235
Epoch 1649
Loss = 6.7522e-03, PNorm = 202.2690, GNorm = 0.1744, lr_0 = 9.9921e-04
Loss = 3.2909e-02, PNorm = 202.3328, GNorm = 1.3697, lr_0 = 9.9921e-04
Validation auc = 0.695925
Epoch 1650
Loss = 1.5324e-02, PNorm = 202.3988, GNorm = 1.1994, lr_0 = 9.9921e-04
Validation auc = 0.701138
Epoch 1651
Loss = 1.4755e-02, PNorm = 202.4549, GNorm = 0.0703, lr_0 = 9.9921e-04
Validation auc = 0.702417
Epoch 1652
Loss = 1.2760e-02, PNorm = 202.5084, GNorm = 0.1320, lr_0 = 9.9921e-04
Validation auc = 0.701529
Epoch 1653
Loss = 4.8739e-02, PNorm = 202.5584, GNorm = 0.8554, lr_0 = 9.9921e-04
Validation auc = 0.707456
Epoch 1654
Loss = 1.9291e-02, PNorm = 202.6141, GNorm = 0.2277, lr_0 = 9.9921e-04
Validation auc = 0.705343
Epoch 1655
Loss = 3.7384e-02, PNorm = 202.6657, GNorm = 0.0293, lr_0 = 9.9921e-04
Validation auc = 0.704387
Epoch 1656
Loss = 1.2141e-02, PNorm = 202.7322, GNorm = 0.9072, lr_0 = 9.9921e-04
Validation auc = 0.698745
Epoch 1657
Loss = 5.5686e-02, PNorm = 202.8351, GNorm = 0.3070, lr_0 = 9.9921e-04
Validation auc = 0.692420
Epoch 1658
Loss = 7.4499e-02, PNorm = 202.9542, GNorm = 3.3891, lr_0 = 9.9921e-04
Validation auc = 0.692607
Epoch 1659
Loss = 3.8576e-03, PNorm = 203.0868, GNorm = 0.1300, lr_0 = 9.9920e-04
Loss = 3.1549e-02, PNorm = 203.1797, GNorm = 0.9826, lr_0 = 9.9920e-04
Validation auc = 0.685131
Epoch 1660
Loss = 4.0046e-02, PNorm = 203.2532, GNorm = 0.8752, lr_0 = 9.9920e-04
Validation auc = 0.705016
Epoch 1661
Loss = 2.0628e-02, PNorm = 203.3330, GNorm = 0.0887, lr_0 = 9.9920e-04
Validation auc = 0.706939
Epoch 1662
Loss = 3.4610e-02, PNorm = 203.3942, GNorm = 0.4808, lr_0 = 9.9920e-04
Validation auc = 0.694751
Epoch 1663
Loss = 1.5765e-02, PNorm = 203.4519, GNorm = 0.2549, lr_0 = 9.9920e-04
Validation auc = 0.692848
Epoch 1664
Loss = 2.8480e-02, PNorm = 203.5075, GNorm = 0.8101, lr_0 = 9.9920e-04
Validation auc = 0.698915
Epoch 1665
Loss = 2.5472e-02, PNorm = 203.5711, GNorm = 0.0440, lr_0 = 9.9920e-04
Validation auc = 0.699780
Epoch 1666
Loss = 2.5374e-02, PNorm = 203.6317, GNorm = 1.4556, lr_0 = 9.9920e-04
Validation auc = 0.696577
Epoch 1667
Loss = 3.0133e-02, PNorm = 203.6836, GNorm = 0.4540, lr_0 = 9.9920e-04
Validation auc = 0.701377
Epoch 1668
Loss = 1.0021e-02, PNorm = 203.7302, GNorm = 0.2623, lr_0 = 9.9920e-04
Validation auc = 0.697196
Epoch 1669
Loss = 6.1076e-03, PNorm = 203.7762, GNorm = 0.2763, lr_0 = 9.9920e-04
Loss = 1.2533e-02, PNorm = 203.8301, GNorm = 1.1647, lr_0 = 9.9920e-04
Validation auc = 0.697480
Epoch 1670
Loss = 2.9345e-02, PNorm = 203.8789, GNorm = 0.4730, lr_0 = 9.9920e-04
Validation auc = 0.691634
Epoch 1671
Loss = 2.1077e-02, PNorm = 203.9291, GNorm = 0.2354, lr_0 = 9.9919e-04
Validation auc = 0.698471
Epoch 1672
Loss = 2.3396e-02, PNorm = 203.9779, GNorm = 0.0570, lr_0 = 9.9919e-04
Validation auc = 0.702980
Epoch 1673
Loss = 1.9575e-02, PNorm = 204.0330, GNorm = 0.0839, lr_0 = 9.9919e-04
Validation auc = 0.706036
Epoch 1674
Loss = 2.2887e-02, PNorm = 204.0750, GNorm = 0.3716, lr_0 = 9.9919e-04
Validation auc = 0.705274
Epoch 1675
Loss = 1.5846e-02, PNorm = 204.1232, GNorm = 0.1934, lr_0 = 9.9919e-04
Validation auc = 0.700812
Epoch 1676
Loss = 9.4547e-03, PNorm = 204.1835, GNorm = 0.1612, lr_0 = 9.9919e-04
Validation auc = 0.703676
Epoch 1677
Loss = 6.8227e-03, PNorm = 204.2387, GNorm = 0.5717, lr_0 = 9.9919e-04
Validation auc = 0.706797
Epoch 1678
Loss = 1.6265e-02, PNorm = 204.2893, GNorm = 0.2125, lr_0 = 9.9919e-04
Validation auc = 0.700274
Epoch 1679
Loss = 1.0513e-02, PNorm = 204.3610, GNorm = 0.4398, lr_0 = 9.9919e-04
Loss = 3.5620e-02, PNorm = 204.4461, GNorm = 0.7563, lr_0 = 9.9919e-04
Validation auc = 0.691802
Epoch 1680
Loss = 1.7331e-02, PNorm = 204.5047, GNorm = 1.4559, lr_0 = 9.9919e-04
Validation auc = 0.695489
Epoch 1681
Loss = 2.3517e-02, PNorm = 204.5594, GNorm = 1.6895, lr_0 = 9.9919e-04
Validation auc = 0.701326
Epoch 1682
Loss = 1.6337e-02, PNorm = 204.6182, GNorm = 0.0229, lr_0 = 9.9919e-04
Validation auc = 0.701502
Epoch 1683
Loss = 2.9441e-02, PNorm = 204.6715, GNorm = 0.1565, lr_0 = 9.9919e-04
Validation auc = 0.694148
Epoch 1684
Loss = 4.6183e-02, PNorm = 204.7272, GNorm = 1.1142, lr_0 = 9.9919e-04
Validation auc = 0.698844
Epoch 1685
Loss = 2.4692e-02, PNorm = 204.7946, GNorm = 0.2954, lr_0 = 9.9918e-04
Validation auc = 0.707635
Epoch 1686
Loss = 1.1524e-01, PNorm = 204.8596, GNorm = 0.4408, lr_0 = 9.9918e-04
Validation auc = 0.706055
Epoch 1687
Loss = 2.2207e-02, PNorm = 204.9193, GNorm = 0.1346, lr_0 = 9.9918e-04
Validation auc = 0.701688
Epoch 1688
Loss = 5.7266e-02, PNorm = 204.9811, GNorm = 0.3915, lr_0 = 9.9918e-04
Validation auc = 0.699344
Epoch 1689
Loss = 5.4666e-03, PNorm = 205.0481, GNorm = 0.1302, lr_0 = 9.9918e-04
Loss = 3.4212e-02, PNorm = 205.1251, GNorm = 0.0869, lr_0 = 9.9918e-04
Validation auc = 0.696605
Epoch 1690
Loss = 2.0272e-02, PNorm = 205.1997, GNorm = 1.0482, lr_0 = 9.9918e-04
Validation auc = 0.701769
Epoch 1691
Loss = 1.9763e-02, PNorm = 205.2647, GNorm = 0.3696, lr_0 = 9.9918e-04
Validation auc = 0.699884
Epoch 1692
Loss = 3.0091e-02, PNorm = 205.3124, GNorm = 0.7808, lr_0 = 9.9918e-04
Validation auc = 0.695142
Epoch 1693
Loss = 1.0015e-02, PNorm = 205.3586, GNorm = 0.0716, lr_0 = 9.9918e-04
Validation auc = 0.695770
Epoch 1694
Loss = 2.3371e-02, PNorm = 205.3976, GNorm = 0.0243, lr_0 = 9.9918e-04
Validation auc = 0.691336
Epoch 1695
Loss = 1.2707e-02, PNorm = 205.4453, GNorm = 1.1897, lr_0 = 9.9918e-04
Validation auc = 0.703501
Epoch 1696
Loss = 8.1331e-03, PNorm = 205.5066, GNorm = 0.4428, lr_0 = 9.9918e-04
Validation auc = 0.710032
Epoch 1697
Loss = 7.7622e-04, PNorm = 205.5759, GNorm = 0.0079, lr_0 = 9.9918e-04
Validation auc = 0.714167
Epoch 1698
Loss = 4.1982e-03, PNorm = 205.6328, GNorm = 0.4010, lr_0 = 9.9917e-04
Validation auc = 0.723084
Epoch 1699
Loss = 5.8460e-02, PNorm = 205.6940, GNorm = 2.2800, lr_0 = 9.9917e-04
Loss = 1.3273e-02, PNorm = 205.7954, GNorm = 0.1441, lr_0 = 9.9917e-04
Validation auc = 0.734039
Epoch 1700
Loss = 2.6760e-02, PNorm = 205.8805, GNorm = 0.4918, lr_0 = 9.9917e-04
Validation auc = 0.723408
Epoch 1701
Loss = 4.1266e-02, PNorm = 205.9591, GNorm = 0.0914, lr_0 = 9.9917e-04
Validation auc = 0.717826
Epoch 1702
Loss = 2.5037e-02, PNorm = 206.0247, GNorm = 0.2378, lr_0 = 9.9917e-04
Validation auc = 0.711467
Epoch 1703
Loss = 9.6514e-03, PNorm = 206.0969, GNorm = 0.3590, lr_0 = 9.9917e-04
Validation auc = 0.710610
Epoch 1704
Loss = 1.6477e-02, PNorm = 206.1533, GNorm = 0.0416, lr_0 = 9.9917e-04
Validation auc = 0.709556
Epoch 1705
Loss = 7.0091e-03, PNorm = 206.1974, GNorm = 0.0923, lr_0 = 9.9917e-04
Validation auc = 0.715251
Epoch 1706
Loss = 7.2098e-02, PNorm = 206.2303, GNorm = 0.0327, lr_0 = 9.9917e-04
Validation auc = 0.706631
Epoch 1707
Loss = 1.5231e-02, PNorm = 206.2812, GNorm = 0.1592, lr_0 = 9.9917e-04
Validation auc = 0.700870
Epoch 1708
Loss = 6.3436e-03, PNorm = 206.3354, GNorm = 0.2497, lr_0 = 9.9917e-04
Validation auc = 0.704475
Epoch 1709
Loss = 5.5478e-02, PNorm = 206.4104, GNorm = 1.7357, lr_0 = 9.9917e-04
Loss = 3.1725e-02, PNorm = 206.4900, GNorm = 0.4946, lr_0 = 9.9917e-04
Validation auc = 0.715378
Epoch 1710
Loss = 2.2425e-02, PNorm = 206.5629, GNorm = 1.0427, lr_0 = 9.9917e-04
Validation auc = 0.715553
Epoch 1711
Loss = 2.4608e-02, PNorm = 206.6216, GNorm = 0.1117, lr_0 = 9.9916e-04
Validation auc = 0.723920
Epoch 1712
Loss = 2.9574e-02, PNorm = 206.6848, GNorm = 0.1622, lr_0 = 9.9916e-04
Validation auc = 0.718925
Epoch 1713
Loss = 2.6314e-02, PNorm = 206.7554, GNorm = 0.2280, lr_0 = 9.9916e-04
Validation auc = 0.714457
Epoch 1714
Loss = 4.9541e-02, PNorm = 206.8216, GNorm = 1.2729, lr_0 = 9.9916e-04
Validation auc = 0.710410
Epoch 1715
Loss = 3.2762e-02, PNorm = 206.8806, GNorm = 2.3847, lr_0 = 9.9916e-04
Validation auc = 0.713652
Epoch 1716
Loss = 5.0616e-02, PNorm = 206.9539, GNorm = 0.2523, lr_0 = 9.9916e-04
Validation auc = 0.717701
Epoch 1717
Loss = 9.4472e-03, PNorm = 207.0376, GNorm = 0.0132, lr_0 = 9.9916e-04
Validation auc = 0.702530
Epoch 1718
Loss = 7.0698e-02, PNorm = 207.1140, GNorm = 0.6848, lr_0 = 9.9916e-04
Validation auc = 0.698302
Epoch 1719
Loss = 7.5544e-03, PNorm = 207.1654, GNorm = 0.7785, lr_0 = 9.9916e-04
Loss = 4.0207e-02, PNorm = 207.2416, GNorm = 0.8583, lr_0 = 9.9916e-04
Validation auc = 0.707323
Epoch 1720
Loss = 4.3385e-02, PNorm = 207.3210, GNorm = 0.7461, lr_0 = 9.9916e-04
Validation auc = 0.720166
Epoch 1721
Loss = 2.0553e-02, PNorm = 207.4085, GNorm = 0.3227, lr_0 = 9.9916e-04
Validation auc = 0.725353
Epoch 1722
Loss = 1.5374e-02, PNorm = 207.4833, GNorm = 2.0049, lr_0 = 9.9916e-04
Validation auc = 0.734995
Epoch 1723
Loss = 4.2398e-02, PNorm = 207.5380, GNorm = 0.2853, lr_0 = 9.9916e-04
Validation auc = 0.741612
Epoch 1724
Loss = 2.8353e-02, PNorm = 207.6104, GNorm = 0.7360, lr_0 = 9.9915e-04
Validation auc = 0.733698
Epoch 1725
Loss = 1.1830e-01, PNorm = 207.6863, GNorm = 1.1134, lr_0 = 9.9915e-04
Validation auc = 0.735157
Epoch 1726
Loss = 2.4071e-02, PNorm = 207.7808, GNorm = 0.6644, lr_0 = 9.9915e-04
Validation auc = 0.732960
Epoch 1727
Loss = 1.2363e-02, PNorm = 207.8750, GNorm = 0.6978, lr_0 = 9.9915e-04
Validation auc = 0.729263
Epoch 1728
Loss = 3.4130e-02, PNorm = 207.9592, GNorm = 0.0832, lr_0 = 9.9915e-04
Validation auc = 0.730943
Epoch 1729
Loss = 9.1618e-02, PNorm = 208.0268, GNorm = 1.1190, lr_0 = 9.9915e-04
Loss = 3.1811e-02, PNorm = 208.1100, GNorm = 0.9172, lr_0 = 9.9915e-04
Validation auc = 0.723189
Epoch 1730
Loss = 3.9649e-02, PNorm = 208.2150, GNorm = 0.2005, lr_0 = 9.9915e-04
Validation auc = 0.728519
Epoch 1731
Loss = 3.9268e-02, PNorm = 208.2985, GNorm = 0.2630, lr_0 = 9.9915e-04
Validation auc = 0.721592
Epoch 1732
Loss = 9.2218e-03, PNorm = 208.3601, GNorm = 0.5359, lr_0 = 9.9915e-04
Validation auc = 0.716237
Epoch 1733
Loss = 5.6334e-02, PNorm = 208.4116, GNorm = 1.8721, lr_0 = 9.9915e-04
Validation auc = 0.710489
Epoch 1734
Loss = 1.9545e-02, PNorm = 208.4636, GNorm = 2.0309, lr_0 = 9.9915e-04
Validation auc = 0.720303
Epoch 1735
Loss = 1.5068e-02, PNorm = 208.5186, GNorm = 0.3920, lr_0 = 9.9915e-04
Validation auc = 0.729378
Epoch 1736
Loss = 5.9568e-03, PNorm = 208.5703, GNorm = 0.3024, lr_0 = 9.9915e-04
Validation auc = 0.728634
Epoch 1737
Loss = 3.7338e-03, PNorm = 208.6201, GNorm = 0.1620, lr_0 = 9.9915e-04
Validation auc = 0.723884
Epoch 1738
Loss = 6.2765e-02, PNorm = 208.6751, GNorm = 1.7864, lr_0 = 9.9914e-04
Validation auc = 0.694018
Epoch 1739
Loss = 1.1497e-03, PNorm = 208.7395, GNorm = 0.0339, lr_0 = 9.9914e-04
Loss = 1.0223e-01, PNorm = 208.8312, GNorm = 2.7426, lr_0 = 9.9914e-04
Validation auc = 0.691228
Epoch 1740
Loss = 2.7044e-02, PNorm = 208.9203, GNorm = 0.2247, lr_0 = 9.9914e-04
Validation auc = 0.690428
Epoch 1741
Loss = 4.1879e-02, PNorm = 209.0078, GNorm = 0.8451, lr_0 = 9.9914e-04
Validation auc = 0.698234
Epoch 1742
Loss = 2.0335e-02, PNorm = 209.0867, GNorm = 1.0229, lr_0 = 9.9914e-04
Validation auc = 0.697300
Epoch 1743
Loss = 3.8601e-03, PNorm = 209.1482, GNorm = 0.0607, lr_0 = 9.9914e-04
Validation auc = 0.700452
Epoch 1744
Loss = 1.0460e-02, PNorm = 209.1939, GNorm = 1.4097, lr_0 = 9.9914e-04
Validation auc = 0.707335
Epoch 1745
Loss = 2.6156e-02, PNorm = 209.2575, GNorm = 0.0507, lr_0 = 9.9914e-04
Validation auc = 0.717727
Epoch 1746
Loss = 4.0222e-02, PNorm = 209.3328, GNorm = 1.3843, lr_0 = 9.9914e-04
Validation auc = 0.716637
Epoch 1747
Loss = 1.5296e-02, PNorm = 209.3931, GNorm = 0.7024, lr_0 = 9.9914e-04
Validation auc = 0.690593
Epoch 1748
Loss = 2.1347e-02, PNorm = 209.4606, GNorm = 1.3079, lr_0 = 9.9914e-04
Validation auc = 0.700435
Epoch 1749
Loss = 2.4075e-02, PNorm = 209.5240, GNorm = 1.1102, lr_0 = 9.9914e-04
Loss = 4.3860e-02, PNorm = 209.6007, GNorm = 2.1090, lr_0 = 9.9914e-04
Validation auc = 0.696341
Epoch 1750
Loss = 3.5113e-02, PNorm = 209.6701, GNorm = 0.3973, lr_0 = 9.9913e-04
Validation auc = 0.693884
Epoch 1751
Loss = 4.1278e-02, PNorm = 209.7345, GNorm = 1.7653, lr_0 = 9.9913e-04
Validation auc = 0.690427
Epoch 1752
Loss = 1.3640e-02, PNorm = 209.7914, GNorm = 0.8468, lr_0 = 9.9913e-04
Validation auc = 0.694302
Epoch 1753
Loss = 2.7050e-02, PNorm = 209.8480, GNorm = 1.5715, lr_0 = 9.9913e-04
Validation auc = 0.694282
Epoch 1754
Loss = 5.3766e-02, PNorm = 209.9128, GNorm = 1.8044, lr_0 = 9.9913e-04
Validation auc = 0.694092
Epoch 1755
Loss = 1.3867e-02, PNorm = 209.9750, GNorm = 0.9556, lr_0 = 9.9913e-04
Validation auc = 0.693632
Epoch 1756
Loss = 2.8805e-02, PNorm = 210.0282, GNorm = 0.2968, lr_0 = 9.9913e-04
Validation auc = 0.689108
Epoch 1757
Loss = 1.6776e-02, PNorm = 210.0773, GNorm = 1.2701, lr_0 = 9.9913e-04
Validation auc = 0.685391
Epoch 1758
Loss = 5.2174e-03, PNorm = 210.1322, GNorm = 0.1250, lr_0 = 9.9913e-04
Validation auc = 0.691606
Epoch 1759
Loss = 4.8212e-02, PNorm = 210.1823, GNorm = 1.4834, lr_0 = 9.9913e-04
Loss = 1.7973e-02, PNorm = 210.2327, GNorm = 0.4641, lr_0 = 9.9913e-04
Validation auc = 0.693320
Epoch 1760
Loss = 1.2211e-02, PNorm = 210.2910, GNorm = 0.1227, lr_0 = 9.9913e-04
Validation auc = 0.700224
Epoch 1761
Loss = 4.7637e-02, PNorm = 210.3437, GNorm = 1.7548, lr_0 = 9.9913e-04
Validation auc = 0.697107
Epoch 1762
Loss = 1.0331e-02, PNorm = 210.4191, GNorm = 0.2660, lr_0 = 9.9913e-04
Validation auc = 0.699458
Epoch 1763
Loss = 1.8157e-02, PNorm = 210.4925, GNorm = 0.0618, lr_0 = 9.9913e-04
Validation auc = 0.697834
Epoch 1764
Loss = 1.7331e-02, PNorm = 210.5616, GNorm = 0.1258, lr_0 = 9.9912e-04
Validation auc = 0.697899
Epoch 1765
Loss = 4.5712e-02, PNorm = 210.6137, GNorm = 2.2185, lr_0 = 9.9912e-04
Validation auc = 0.691739
Epoch 1766
Loss = 1.0086e-02, PNorm = 210.6758, GNorm = 0.1746, lr_0 = 9.9912e-04
Validation auc = 0.700470
Epoch 1767
Loss = 2.8604e-03, PNorm = 210.7363, GNorm = 0.1989, lr_0 = 9.9912e-04
Validation auc = 0.703486
Epoch 1768
Loss = 8.4889e-04, PNorm = 210.7849, GNorm = 0.0167, lr_0 = 9.9912e-04
Validation auc = 0.708321
Epoch 1769
Loss = 2.6473e-01, PNorm = 210.8321, GNorm = 2.1241, lr_0 = 9.9912e-04
Loss = 6.4979e-02, PNorm = 210.9016, GNorm = 0.1852, lr_0 = 9.9912e-04
Validation auc = 0.699534
Epoch 1770
Loss = 4.7468e-02, PNorm = 211.0028, GNorm = 1.4650, lr_0 = 9.9912e-04
Validation auc = 0.702614
Epoch 1771
Loss = 1.5628e-02, PNorm = 211.0903, GNorm = 0.2892, lr_0 = 9.9912e-04
Validation auc = 0.711286
Epoch 1772
Loss = 3.8387e-02, PNorm = 211.1486, GNorm = 0.6445, lr_0 = 9.9912e-04
Validation auc = 0.712520
Epoch 1773
Loss = 5.6109e-02, PNorm = 211.1982, GNorm = 0.8513, lr_0 = 9.9912e-04
Validation auc = 0.705242
Epoch 1774
Loss = 3.8001e-02, PNorm = 211.2386, GNorm = 2.2499, lr_0 = 9.9912e-04
Validation auc = 0.696153
Epoch 1775
Loss = 3.1092e-02, PNorm = 211.2961, GNorm = 0.2148, lr_0 = 9.9912e-04
Validation auc = 0.687199
Epoch 1776
Loss = 3.6328e-02, PNorm = 211.3528, GNorm = 0.0877, lr_0 = 9.9912e-04
Validation auc = 0.689478
Epoch 1777
Loss = 1.1813e-02, PNorm = 211.4024, GNorm = 0.1565, lr_0 = 9.9911e-04
Validation auc = 0.701905
Epoch 1778
Loss = 1.1525e-02, PNorm = 211.4509, GNorm = 0.1112, lr_0 = 9.9911e-04
Validation auc = 0.705099
Epoch 1779
Loss = 1.1009e-02, PNorm = 211.5030, GNorm = 0.3323, lr_0 = 9.9911e-04
Loss = 1.8678e-02, PNorm = 211.5507, GNorm = 2.9858, lr_0 = 9.9911e-04
Validation auc = 0.707844
Epoch 1780
Loss = 2.6946e-02, PNorm = 211.6117, GNorm = 0.1158, lr_0 = 9.9911e-04
Validation auc = 0.719433
Epoch 1781
Loss = 3.0193e-02, PNorm = 211.6685, GNorm = 0.6721, lr_0 = 9.9911e-04
Validation auc = 0.715157
Epoch 1782
Loss = 9.6116e-03, PNorm = 211.7151, GNorm = 0.0718, lr_0 = 9.9911e-04
Validation auc = 0.715263
Epoch 1783
Loss = 4.4009e-02, PNorm = 211.7671, GNorm = 0.0364, lr_0 = 9.9911e-04
Validation auc = 0.707636
Epoch 1784
Loss = 2.1449e-02, PNorm = 211.8428, GNorm = 0.5356, lr_0 = 9.9911e-04
Validation auc = 0.716494
Epoch 1785
Loss = 1.7707e-02, PNorm = 211.9087, GNorm = 1.4959, lr_0 = 9.9911e-04
Validation auc = 0.725184
Epoch 1786
Loss = 4.6742e-03, PNorm = 211.9742, GNorm = 0.1710, lr_0 = 9.9911e-04
Validation auc = 0.727778
Epoch 1787
Loss = 5.7976e-03, PNorm = 212.0257, GNorm = 0.1494, lr_0 = 9.9911e-04
Validation auc = 0.718308
Epoch 1788
Loss = 3.3586e-02, PNorm = 212.0832, GNorm = 1.6443, lr_0 = 9.9911e-04
Validation auc = 0.722844
Epoch 1789
Loss = 2.0603e-02, PNorm = 212.1512, GNorm = 0.6765, lr_0 = 9.9911e-04
Loss = 5.3302e-02, PNorm = 212.2452, GNorm = 2.0714, lr_0 = 9.9911e-04
Validation auc = 0.729175
Epoch 1790
Loss = 2.2387e-02, PNorm = 212.3400, GNorm = 0.8552, lr_0 = 9.9910e-04
Validation auc = 0.728582
Epoch 1791
Loss = 1.5332e-02, PNorm = 212.4151, GNorm = 0.2021, lr_0 = 9.9910e-04
Validation auc = 0.726639
Epoch 1792
Loss = 3.7326e-02, PNorm = 212.4681, GNorm = 0.4982, lr_0 = 9.9910e-04
Validation auc = 0.719260
Epoch 1793
Loss = 2.7607e-02, PNorm = 212.5280, GNorm = 1.4597, lr_0 = 9.9910e-04
Validation auc = 0.707731
Epoch 1794
Loss = 2.6389e-02, PNorm = 212.5991, GNorm = 1.1082, lr_0 = 9.9910e-04
Validation auc = 0.692123
Epoch 1795
Loss = 1.1519e-02, PNorm = 212.6678, GNorm = 0.1532, lr_0 = 9.9910e-04
Validation auc = 0.696297
Epoch 1796
Loss = 2.3661e-02, PNorm = 212.7216, GNorm = 0.1327, lr_0 = 9.9910e-04
Validation auc = 0.708902
Epoch 1797
Loss = 4.5505e-02, PNorm = 212.7859, GNorm = 0.7642, lr_0 = 9.9910e-04
Validation auc = 0.706954
Epoch 1798
Loss = 2.0953e-03, PNorm = 212.8482, GNorm = 0.0241, lr_0 = 9.9910e-04
Validation auc = 0.698680
Epoch 1799
Loss = 5.7516e-02, PNorm = 212.9188, GNorm = 1.9885, lr_0 = 9.9910e-04
Loss = 1.9424e-02, PNorm = 212.9809, GNorm = 0.0505, lr_0 = 9.9910e-04
Validation auc = 0.696120
Epoch 1800
Loss = 2.2793e-02, PNorm = 213.0411, GNorm = 0.0413, lr_0 = 9.9910e-04
Validation auc = 0.706226
Epoch 1801
Loss = 1.4390e-02, PNorm = 213.0922, GNorm = 1.2247, lr_0 = 9.9910e-04
Validation auc = 0.703360
Epoch 1802
Loss = 1.7568e-02, PNorm = 213.1556, GNorm = 0.0647, lr_0 = 9.9910e-04
Validation auc = 0.692791
Epoch 1803
Loss = 1.4224e-02, PNorm = 213.2243, GNorm = 2.4089, lr_0 = 9.9909e-04
Validation auc = 0.696744
Epoch 1804
Loss = 8.2103e-02, PNorm = 213.2815, GNorm = 0.2809, lr_0 = 9.9909e-04
Validation auc = 0.702859
Epoch 1805
Loss = 1.5235e-02, PNorm = 213.3585, GNorm = 0.1100, lr_0 = 9.9909e-04
Validation auc = 0.694793
Epoch 1806
Loss = 4.7637e-02, PNorm = 213.4337, GNorm = 1.2237, lr_0 = 9.9909e-04
Validation auc = 0.688292
Epoch 1807
Loss = 1.7421e-03, PNorm = 213.5110, GNorm = 0.0317, lr_0 = 9.9909e-04
Validation auc = 0.680992
Epoch 1808
Loss = 1.0043e-01, PNorm = 213.5872, GNorm = 1.6131, lr_0 = 9.9909e-04
Validation auc = 0.672734
Epoch 1809
Loss = 1.1714e-03, PNorm = 213.6774, GNorm = 0.0344, lr_0 = 9.9909e-04
Loss = 4.2486e-02, PNorm = 213.7685, GNorm = 0.4182, lr_0 = 9.9909e-04
Validation auc = 0.677450
Epoch 1810
Loss = 4.0123e-02, PNorm = 213.8523, GNorm = 0.4524, lr_0 = 9.9909e-04
Validation auc = 0.693543
Epoch 1811
Loss = 1.5922e-02, PNorm = 213.9270, GNorm = 0.0655, lr_0 = 9.9909e-04
Validation auc = 0.697993
Epoch 1812
Loss = 2.0294e-02, PNorm = 213.9804, GNorm = 0.6675, lr_0 = 9.9909e-04
Validation auc = 0.697476
Epoch 1813
Loss = 6.1372e-03, PNorm = 214.0242, GNorm = 0.0488, lr_0 = 9.9909e-04
Validation auc = 0.694062
Epoch 1814
Loss = 1.4801e-02, PNorm = 214.0543, GNorm = 0.7803, lr_0 = 9.9909e-04
Validation auc = 0.689014
Epoch 1815
Loss = 8.3653e-03, PNorm = 214.0972, GNorm = 0.8325, lr_0 = 9.9909e-04
Validation auc = 0.684155
Epoch 1816
Loss = 5.0582e-03, PNorm = 214.1382, GNorm = 0.2254, lr_0 = 9.9909e-04
Validation auc = 0.686704
Epoch 1817
Loss = 4.9573e-02, PNorm = 214.1805, GNorm = 0.0622, lr_0 = 9.9908e-04
Validation auc = 0.684256
Epoch 1818
Loss = 9.3059e-03, PNorm = 214.2195, GNorm = 0.6116, lr_0 = 9.9908e-04
Validation auc = 0.693807
Epoch 1819
Loss = 1.1796e-02, PNorm = 214.2659, GNorm = 0.4766, lr_0 = 9.9908e-04
Loss = 1.4614e-02, PNorm = 214.3160, GNorm = 0.0497, lr_0 = 9.9908e-04
Validation auc = 0.709706
Epoch 1820
Loss = 4.4035e-02, PNorm = 214.3570, GNorm = 0.0423, lr_0 = 9.9908e-04
Validation auc = 0.717901
Epoch 1821
Loss = 5.3622e-02, PNorm = 214.3991, GNorm = 1.3114, lr_0 = 9.9908e-04
Validation auc = 0.719129
Epoch 1822
Loss = 1.7041e-02, PNorm = 214.4543, GNorm = 0.5595, lr_0 = 9.9908e-04
Validation auc = 0.721363
Epoch 1823
Loss = 2.8574e-02, PNorm = 214.5025, GNorm = 0.1795, lr_0 = 9.9908e-04
Validation auc = 0.724204
Epoch 1824
Loss = 6.2529e-02, PNorm = 214.5380, GNorm = 0.0756, lr_0 = 9.9908e-04
Validation auc = 0.724357
Epoch 1825
Loss = 1.8685e-02, PNorm = 214.5808, GNorm = 1.8312, lr_0 = 9.9908e-04
Validation auc = 0.716078
Epoch 1826
Loss = 4.9064e-02, PNorm = 214.6344, GNorm = 0.1228, lr_0 = 9.9908e-04
Validation auc = 0.725823
Epoch 1827
Loss = 2.0315e-02, PNorm = 214.7047, GNorm = 0.1415, lr_0 = 9.9908e-04
Validation auc = 0.722486
Epoch 1828
Loss = 3.7744e-03, PNorm = 214.7862, GNorm = 0.0626, lr_0 = 9.9908e-04
Validation auc = 0.709801
Epoch 1829
Loss = 1.3606e-03, PNorm = 214.8593, GNorm = 0.0503, lr_0 = 9.9908e-04
Loss = 2.7187e-02, PNorm = 214.9652, GNorm = 1.0462, lr_0 = 9.9908e-04
Validation auc = 0.694424
Epoch 1830
Loss = 2.2689e-02, PNorm = 215.0472, GNorm = 0.1732, lr_0 = 9.9907e-04
Validation auc = 0.700457
Epoch 1831
Loss = 6.2125e-02, PNorm = 215.1351, GNorm = 0.9296, lr_0 = 9.9907e-04
Validation auc = 0.700767
Epoch 1832
Loss = 3.5783e-02, PNorm = 215.2300, GNorm = 0.1375, lr_0 = 9.9907e-04
Validation auc = 0.697693
Epoch 1833
Loss = 4.1991e-02, PNorm = 215.3118, GNorm = 0.1997, lr_0 = 9.9907e-04
Validation auc = 0.704273
Epoch 1834
Loss = 2.8464e-02, PNorm = 215.3863, GNorm = 0.1154, lr_0 = 9.9907e-04
Validation auc = 0.709617
Epoch 1835
Loss = 9.9769e-03, PNorm = 215.4537, GNorm = 0.6069, lr_0 = 9.9907e-04
Validation auc = 0.712650
Epoch 1836
Loss = 1.3877e-02, PNorm = 215.5075, GNorm = 0.0636, lr_0 = 9.9907e-04
Validation auc = 0.716107
Epoch 1837
Loss = 1.6805e-02, PNorm = 215.5617, GNorm = 0.1085, lr_0 = 9.9907e-04
Validation auc = 0.723130
Epoch 1838
Loss = 5.5713e-03, PNorm = 215.6202, GNorm = 0.0327, lr_0 = 9.9907e-04
Validation auc = 0.712700
Epoch 1839
Loss = 2.6322e-03, PNorm = 215.6799, GNorm = 0.2572, lr_0 = 9.9907e-04
Loss = 8.5001e-03, PNorm = 215.7337, GNorm = 0.7270, lr_0 = 9.9907e-04
Validation auc = 0.707458
Epoch 1840
Loss = 5.3295e-02, PNorm = 215.7656, GNorm = 0.4433, lr_0 = 9.9907e-04
Validation auc = 0.710738
Epoch 1841
Loss = 1.4184e-02, PNorm = 215.8010, GNorm = 0.0485, lr_0 = 9.9907e-04
Validation auc = 0.709385
Epoch 1842
Loss = 2.0553e-02, PNorm = 215.8523, GNorm = 0.6153, lr_0 = 9.9907e-04
Validation auc = 0.698234
Epoch 1843
Loss = 2.1127e-02, PNorm = 215.9078, GNorm = 3.1462, lr_0 = 9.9906e-04
Validation auc = 0.701188
Epoch 1844
Loss = 1.5285e-02, PNorm = 215.9769, GNorm = 0.4443, lr_0 = 9.9906e-04
Validation auc = 0.705722
Epoch 1845
Loss = 3.6573e-02, PNorm = 216.0594, GNorm = 0.2739, lr_0 = 9.9906e-04
Validation auc = 0.707242
Epoch 1846
Loss = 4.2667e-02, PNorm = 216.1253, GNorm = 4.1189, lr_0 = 9.9906e-04
Validation auc = 0.714919
Epoch 1847
Loss = 2.5331e-02, PNorm = 216.1900, GNorm = 1.3651, lr_0 = 9.9906e-04
Validation auc = 0.713381
Epoch 1848
Loss = 4.5983e-02, PNorm = 216.2635, GNorm = 1.0778, lr_0 = 9.9906e-04
Validation auc = 0.709493
Epoch 1849
Loss = 6.0748e-03, PNorm = 216.3383, GNorm = 0.2374, lr_0 = 9.9906e-04
Loss = 2.4743e-02, PNorm = 216.4079, GNorm = 1.7484, lr_0 = 9.9906e-04
Validation auc = 0.702958
Epoch 1850
Loss = 1.9255e-02, PNorm = 216.4783, GNorm = 0.0504, lr_0 = 9.9906e-04
Validation auc = 0.695029
Epoch 1851
Loss = 4.4094e-02, PNorm = 216.5492, GNorm = 0.5015, lr_0 = 9.9906e-04
Validation auc = 0.693012
Epoch 1852
Loss = 2.5541e-02, PNorm = 216.6650, GNorm = 0.4665, lr_0 = 9.9906e-04
Validation auc = 0.692873
Epoch 1853
Loss = 2.0000e-02, PNorm = 216.7694, GNorm = 1.2179, lr_0 = 9.9906e-04
Validation auc = 0.687611
Epoch 1854
Loss = 3.2435e-02, PNorm = 216.8485, GNorm = 1.5032, lr_0 = 9.9906e-04
Validation auc = 0.679361
Epoch 1855
Loss = 1.2675e-02, PNorm = 216.9356, GNorm = 1.1780, lr_0 = 9.9906e-04
Validation auc = 0.675830
Epoch 1856
Loss = 1.7124e-02, PNorm = 217.0167, GNorm = 1.5067, lr_0 = 9.9906e-04
Validation auc = 0.676327
Epoch 1857
Loss = 7.5559e-02, PNorm = 217.0841, GNorm = 1.1771, lr_0 = 9.9905e-04
Validation auc = 0.674574
Epoch 1858
Loss = 4.6823e-02, PNorm = 217.1993, GNorm = 1.0362, lr_0 = 9.9905e-04
Validation auc = 0.684348
Epoch 1859
Loss = 1.4480e-02, PNorm = 217.3299, GNorm = 0.3910, lr_0 = 9.9905e-04
Loss = 6.2662e-02, PNorm = 217.4470, GNorm = 0.4737, lr_0 = 9.9905e-04
Validation auc = 0.695092
Epoch 1860
Loss = 2.3219e-02, PNorm = 217.5500, GNorm = 0.4431, lr_0 = 9.9905e-04
Validation auc = 0.692696
Epoch 1861
Loss = 2.5295e-02, PNorm = 217.6274, GNorm = 0.1265, lr_0 = 9.9905e-04
Validation auc = 0.691075
Epoch 1862
Loss = 3.7856e-02, PNorm = 217.6834, GNorm = 1.3664, lr_0 = 9.9905e-04
Validation auc = 0.694275
Epoch 1863
Loss = 2.8382e-02, PNorm = 217.7253, GNorm = 0.8876, lr_0 = 9.9905e-04
Validation auc = 0.697059
Epoch 1864
Loss = 1.8745e-02, PNorm = 217.7756, GNorm = 0.2966, lr_0 = 9.9905e-04
Validation auc = 0.705339
Epoch 1865
Loss = 9.5843e-03, PNorm = 217.8321, GNorm = 0.9931, lr_0 = 9.9905e-04
Validation auc = 0.694655
Epoch 1866
Loss = 4.1960e-02, PNorm = 217.8896, GNorm = 1.6509, lr_0 = 9.9905e-04
Validation auc = 0.689119
Epoch 1867
Loss = 5.8861e-03, PNorm = 217.9630, GNorm = 0.1827, lr_0 = 9.9905e-04
Validation auc = 0.689293
Epoch 1868
Loss = 1.9328e-02, PNorm = 218.0358, GNorm = 0.3393, lr_0 = 9.9905e-04
Validation auc = 0.694406
Epoch 1869
Loss = 7.8055e-02, PNorm = 218.1096, GNorm = 2.5798, lr_0 = 9.9905e-04
Loss = 4.0029e-02, PNorm = 218.1979, GNorm = 1.1755, lr_0 = 9.9904e-04
Validation auc = 0.703228
Epoch 1870
Loss = 1.7543e-02, PNorm = 218.2646, GNorm = 0.8890, lr_0 = 9.9904e-04
Validation auc = 0.708929
Epoch 1871
Loss = 1.5495e-02, PNorm = 218.3146, GNorm = 0.9272, lr_0 = 9.9904e-04
Validation auc = 0.716924
Epoch 1872
Loss = 5.2124e-02, PNorm = 218.3629, GNorm = 2.1691, lr_0 = 9.9904e-04
Validation auc = 0.725732
Epoch 1873
Loss = 4.6280e-02, PNorm = 218.4319, GNorm = 0.1481, lr_0 = 9.9904e-04
Validation auc = 0.724023
Epoch 1874
Loss = 3.1991e-02, PNorm = 218.5069, GNorm = 1.6868, lr_0 = 9.9904e-04
Validation auc = 0.718497
Epoch 1875
Loss = 5.1931e-02, PNorm = 218.5726, GNorm = 0.2914, lr_0 = 9.9904e-04
Validation auc = 0.714664
Epoch 1876
Loss = 1.0258e-02, PNorm = 218.6272, GNorm = 1.1480, lr_0 = 9.9904e-04
Validation auc = 0.706418
Epoch 1877
Loss = 5.4516e-03, PNorm = 218.6714, GNorm = 0.5968, lr_0 = 9.9904e-04
Validation auc = 0.708352
Epoch 1878
Loss = 3.3215e-02, PNorm = 218.7071, GNorm = 0.0936, lr_0 = 9.9904e-04
Validation auc = 0.711446
Epoch 1879
Loss = 4.2243e-02, PNorm = 218.7458, GNorm = 1.5999, lr_0 = 9.9904e-04
Loss = 1.9156e-02, PNorm = 218.7863, GNorm = 0.2900, lr_0 = 9.9904e-04
Validation auc = 0.719518
Epoch 1880
Loss = 2.4211e-02, PNorm = 218.8390, GNorm = 0.0517, lr_0 = 9.9904e-04
Validation auc = 0.723392
Epoch 1881
Loss = 4.1888e-02, PNorm = 218.9005, GNorm = 0.0380, lr_0 = 9.9904e-04
Validation auc = 0.717725
Epoch 1882
Loss = 6.5782e-02, PNorm = 218.9684, GNorm = 0.0739, lr_0 = 9.9904e-04
Validation auc = 0.715346
Epoch 1883
Loss = 1.0589e-02, PNorm = 219.0558, GNorm = 0.4473, lr_0 = 9.9903e-04
Validation auc = 0.685294
Epoch 1884
Loss = 2.6236e-02, PNorm = 219.1336, GNorm = 0.2625, lr_0 = 9.9903e-04
Validation auc = 0.690468
Epoch 1885
Loss = 7.1722e-03, PNorm = 219.1951, GNorm = 0.0232, lr_0 = 9.9903e-04
Validation auc = 0.700679
Epoch 1886
Loss = 1.9070e-03, PNorm = 219.2384, GNorm = 0.0434, lr_0 = 9.9903e-04
Validation auc = 0.707213
Epoch 1887
Loss = 1.0424e-02, PNorm = 219.2877, GNorm = 0.2193, lr_0 = 9.9903e-04
Validation auc = 0.710005
Epoch 1888
Loss = 2.1436e-03, PNorm = 219.3435, GNorm = 0.1033, lr_0 = 9.9903e-04
Validation auc = 0.712094
Epoch 1889
Loss = 4.4830e-03, PNorm = 219.4232, GNorm = 0.2004, lr_0 = 9.9903e-04
Loss = 4.8375e-02, PNorm = 219.5305, GNorm = 1.9567, lr_0 = 9.9903e-04
Validation auc = 0.713728
Epoch 1890
Loss = 4.2818e-02, PNorm = 219.6308, GNorm = 1.2330, lr_0 = 9.9903e-04
Validation auc = 0.706866
Epoch 1891
Loss = 2.4467e-02, PNorm = 219.7290, GNorm = 0.4733, lr_0 = 9.9903e-04
Validation auc = 0.709420
Epoch 1892
Loss = 2.9820e-02, PNorm = 219.8087, GNorm = 0.0221, lr_0 = 9.9903e-04
Validation auc = 0.710470
Epoch 1893
Loss = 1.5884e-02, PNorm = 219.8701, GNorm = 0.0422, lr_0 = 9.9903e-04
Validation auc = 0.712795
Epoch 1894
Loss = 6.8953e-03, PNorm = 219.9168, GNorm = 0.0520, lr_0 = 9.9903e-04
Validation auc = 0.712322
Epoch 1895
Loss = 2.2577e-02, PNorm = 219.9629, GNorm = 1.6117, lr_0 = 9.9903e-04
Validation auc = 0.708027
Epoch 1896
Loss = 3.0234e-02, PNorm = 220.0157, GNorm = 0.1130, lr_0 = 9.9902e-04
Validation auc = 0.707234
Epoch 1897
Loss = 5.1301e-03, PNorm = 220.0733, GNorm = 0.3333, lr_0 = 9.9902e-04
Validation auc = 0.714658
Epoch 1898
Loss = 2.1795e-02, PNorm = 220.1364, GNorm = 0.5295, lr_0 = 9.9902e-04
Validation auc = 0.719067
Epoch 1899
Loss = 1.3503e-02, PNorm = 220.2003, GNorm = 0.3180, lr_0 = 9.9902e-04
Loss = 1.4323e-02, PNorm = 220.2507, GNorm = 0.4762, lr_0 = 9.9902e-04
Validation auc = 0.717330
Epoch 1900
Loss = 3.9449e-02, PNorm = 220.3003, GNorm = 0.4324, lr_0 = 9.9902e-04
Validation auc = 0.713785
Epoch 1901
Loss = 2.8525e-02, PNorm = 220.3555, GNorm = 0.7105, lr_0 = 9.9902e-04
Validation auc = 0.711134
Epoch 1902
Loss = 2.1067e-02, PNorm = 220.4117, GNorm = 0.0742, lr_0 = 9.9902e-04
Validation auc = 0.714030
Epoch 1903
Loss = 2.8636e-02, PNorm = 220.4610, GNorm = 0.5862, lr_0 = 9.9902e-04
Validation auc = 0.717051
Epoch 1904
Loss = 3.8714e-03, PNorm = 220.5098, GNorm = 0.1145, lr_0 = 9.9902e-04
Validation auc = 0.718623
Epoch 1905
Loss = 1.4692e-02, PNorm = 220.5517, GNorm = 1.0212, lr_0 = 9.9902e-04
Validation auc = 0.717889
Epoch 1906
Loss = 1.0007e-02, PNorm = 220.5907, GNorm = 1.1387, lr_0 = 9.9902e-04
Validation auc = 0.715984
Epoch 1907
Loss = 3.0367e-03, PNorm = 220.6305, GNorm = 0.0840, lr_0 = 9.9902e-04
Validation auc = 0.708713
Epoch 1908
Loss = 1.8923e-02, PNorm = 220.6740, GNorm = 0.1410, lr_0 = 9.9902e-04
Validation auc = 0.708633
Epoch 1909
Loss = 2.2925e-03, PNorm = 220.7341, GNorm = 0.0930, lr_0 = 9.9902e-04
Loss = 1.7206e-02, PNorm = 220.7993, GNorm = 2.0164, lr_0 = 9.9901e-04
Validation auc = 0.707753
Epoch 1910
Loss = 8.8292e-03, PNorm = 220.8676, GNorm = 0.4313, lr_0 = 9.9901e-04
Validation auc = 0.718228
Epoch 1911
Loss = 4.2131e-02, PNorm = 220.9177, GNorm = 0.5559, lr_0 = 9.9901e-04
Validation auc = 0.720196
Epoch 1912
Loss = 2.5246e-02, PNorm = 220.9719, GNorm = 0.0574, lr_0 = 9.9901e-04
Validation auc = 0.718486
Epoch 1913
Loss = 5.1332e-02, PNorm = 221.0314, GNorm = 0.9733, lr_0 = 9.9901e-04
Validation auc = 0.716747
Epoch 1914
Loss = 6.2866e-02, PNorm = 221.1005, GNorm = 1.7758, lr_0 = 9.9901e-04
Validation auc = 0.719566
Epoch 1915
Loss = 3.2281e-02, PNorm = 221.1835, GNorm = 0.0350, lr_0 = 9.9901e-04
Validation auc = 0.729215
Epoch 1916
Loss = 2.8040e-02, PNorm = 221.2581, GNorm = 0.6388, lr_0 = 9.9901e-04
Validation auc = 0.721040
Epoch 1917
Loss = 1.7890e-02, PNorm = 221.3239, GNorm = 0.0650, lr_0 = 9.9901e-04
Validation auc = 0.713790
Epoch 1918
Loss = 1.1373e-02, PNorm = 221.3972, GNorm = 0.5271, lr_0 = 9.9901e-04
Validation auc = 0.708945
Epoch 1919
Loss = 3.7877e-02, PNorm = 221.4520, GNorm = 1.1143, lr_0 = 9.9901e-04
Loss = 3.2512e-02, PNorm = 221.5071, GNorm = 1.4201, lr_0 = 9.9901e-04
Validation auc = 0.704303
Epoch 1920
Loss = 1.7227e-02, PNorm = 221.5717, GNorm = 0.2905, lr_0 = 9.9901e-04
Validation auc = 0.701865
Epoch 1921
Loss = 2.5049e-02, PNorm = 221.6464, GNorm = 0.0200, lr_0 = 9.9901e-04
Validation auc = 0.693133
Epoch 1922
Loss = 3.6384e-02, PNorm = 221.7224, GNorm = 0.1844, lr_0 = 9.9900e-04
Validation auc = 0.681220
Epoch 1923
Loss = 2.4412e-02, PNorm = 221.7941, GNorm = 0.7269, lr_0 = 9.9900e-04
Validation auc = 0.682717
Epoch 1924
Loss = 1.3064e-02, PNorm = 221.8540, GNorm = 2.7425, lr_0 = 9.9900e-04
Validation auc = 0.692642
Epoch 1925
Loss = 4.1135e-02, PNorm = 221.9039, GNorm = 0.4285, lr_0 = 9.9900e-04
Validation auc = 0.695789
Epoch 1926
Loss = 4.5440e-03, PNorm = 221.9634, GNorm = 0.5828, lr_0 = 9.9900e-04
Validation auc = 0.696990
Epoch 1927
Loss = 5.7593e-03, PNorm = 222.0244, GNorm = 0.9462, lr_0 = 9.9900e-04
Validation auc = 0.702940
Epoch 1928
Loss = 1.7102e-02, PNorm = 222.0825, GNorm = 3.3661, lr_0 = 9.9900e-04
Validation auc = 0.708452
Epoch 1929
Loss = 2.8197e-04, PNorm = 222.1566, GNorm = 0.0133, lr_0 = 9.9900e-04
Loss = 3.5121e-02, PNorm = 222.2208, GNorm = 1.8179, lr_0 = 9.9900e-04
Validation auc = 0.709974
Epoch 1930
Loss = 3.4801e-02, PNorm = 222.2811, GNorm = 1.1938, lr_0 = 9.9900e-04
Validation auc = 0.708264
Epoch 1931
Loss = 1.5606e-02, PNorm = 222.3579, GNorm = 0.0577, lr_0 = 9.9900e-04
Validation auc = 0.707965
Epoch 1932
Loss = 4.2078e-02, PNorm = 222.4375, GNorm = 2.0048, lr_0 = 9.9900e-04
Validation auc = 0.694967
Epoch 1933
Loss = 3.3854e-02, PNorm = 222.5585, GNorm = 0.5452, lr_0 = 9.9900e-04
Validation auc = 0.685519
Epoch 1934
Loss = 1.4067e-02, PNorm = 222.6676, GNorm = 1.4899, lr_0 = 9.9900e-04
Validation auc = 0.690402
Epoch 1935
Loss = 3.2409e-02, PNorm = 222.7525, GNorm = 1.0354, lr_0 = 9.9900e-04
Validation auc = 0.692761
Epoch 1936
Loss = 2.0290e-02, PNorm = 222.8403, GNorm = 2.3692, lr_0 = 9.9899e-04
Validation auc = 0.684942
Epoch 1937
Loss = 1.1804e-02, PNorm = 222.9254, GNorm = 0.2840, lr_0 = 9.9899e-04
Validation auc = 0.680224
Epoch 1938
Loss = 2.3770e-02, PNorm = 222.9935, GNorm = 1.6915, lr_0 = 9.9899e-04
Validation auc = 0.702240
Epoch 1939
Loss = 1.4359e-02, PNorm = 223.0563, GNorm = 0.9068, lr_0 = 9.9899e-04
Loss = 3.8943e-02, PNorm = 223.1285, GNorm = 1.1893, lr_0 = 9.9899e-04
Validation auc = 0.717933
Epoch 1940
Loss = 4.3026e-02, PNorm = 223.2321, GNorm = 1.7746, lr_0 = 9.9899e-04
Validation auc = 0.701967
Epoch 1941
Loss = 3.6796e-02, PNorm = 223.3524, GNorm = 1.1881, lr_0 = 9.9899e-04
Validation auc = 0.709476
Epoch 1942
Loss = 3.9080e-02, PNorm = 223.4676, GNorm = 0.2350, lr_0 = 9.9899e-04
Validation auc = 0.688852
Epoch 1943
Loss = 5.9419e-02, PNorm = 223.5735, GNorm = 0.6935, lr_0 = 9.9899e-04
Validation auc = 0.699438
Epoch 1944
Loss = 2.5855e-02, PNorm = 223.6751, GNorm = 1.3495, lr_0 = 9.9899e-04
Validation auc = 0.705198
Epoch 1945
Loss = 4.3412e-02, PNorm = 223.7541, GNorm = 0.7515, lr_0 = 9.9899e-04
Validation auc = 0.705816
Epoch 1946
Loss = 2.1020e-02, PNorm = 223.8181, GNorm = 1.8442, lr_0 = 9.9899e-04
Validation auc = 0.695213
Epoch 1947
Loss = 2.7037e-02, PNorm = 223.8796, GNorm = 1.3939, lr_0 = 9.9899e-04
Validation auc = 0.683345
Epoch 1948
Loss = 3.5475e-02, PNorm = 223.9390, GNorm = 0.7065, lr_0 = 9.9899e-04
Validation auc = 0.691421
Epoch 1949
Loss = 3.4439e-02, PNorm = 223.9861, GNorm = 1.7848, lr_0 = 9.9898e-04
Loss = 3.3654e-02, PNorm = 224.0351, GNorm = 3.9804, lr_0 = 9.9898e-04
Validation auc = 0.704739
Epoch 1950
Loss = 7.1575e-02, PNorm = 224.1158, GNorm = 0.2532, lr_0 = 9.9898e-04
Validation auc = 0.707521
Epoch 1951
Loss = 5.7211e-02, PNorm = 224.2255, GNorm = 0.9014, lr_0 = 9.9898e-04
Validation auc = 0.705909
Epoch 1952
Loss = 5.5999e-02, PNorm = 224.3285, GNorm = 0.2798, lr_0 = 9.9898e-04
Validation auc = 0.702775
Epoch 1953
Loss = 3.6950e-02, PNorm = 224.4335, GNorm = 0.6123, lr_0 = 9.9898e-04
Validation auc = 0.696680
Epoch 1954
Loss = 4.5425e-02, PNorm = 224.5111, GNorm = 0.4455, lr_0 = 9.9898e-04
Validation auc = 0.703559
Epoch 1955
Loss = 9.8055e-03, PNorm = 224.5675, GNorm = 1.1889, lr_0 = 9.9898e-04
Validation auc = 0.715789
Epoch 1956
Loss = 5.3266e-02, PNorm = 224.6197, GNorm = 0.0617, lr_0 = 9.9898e-04
Validation auc = 0.724059
Epoch 1957
Loss = 2.3990e-02, PNorm = 224.6606, GNorm = 0.3507, lr_0 = 9.9898e-04
Validation auc = 0.722956
Epoch 1958
Loss = 8.4503e-02, PNorm = 224.7113, GNorm = 0.9939, lr_0 = 9.9898e-04
Validation auc = 0.706755
Epoch 1959
Loss = 7.3324e-03, PNorm = 224.7682, GNorm = 0.1590, lr_0 = 9.9898e-04
Loss = 4.4386e-02, PNorm = 224.8145, GNorm = 0.8354, lr_0 = 9.9898e-04
Validation auc = 0.705187
Epoch 1960
Loss = 4.6908e-02, PNorm = 224.8772, GNorm = 0.9034, lr_0 = 9.9898e-04
Validation auc = 0.709989
Epoch 1961
Loss = 1.3354e-02, PNorm = 224.9377, GNorm = 1.2228, lr_0 = 9.9898e-04
Validation auc = 0.714060
Epoch 1962
Loss = 2.4721e-02, PNorm = 224.9850, GNorm = 0.0917, lr_0 = 9.9897e-04
Validation auc = 0.716763
Epoch 1963
Loss = 2.9916e-02, PNorm = 225.0365, GNorm = 0.1768, lr_0 = 9.9897e-04
Validation auc = 0.716343
Epoch 1964
Loss = 5.2152e-03, PNorm = 225.0868, GNorm = 0.2220, lr_0 = 9.9897e-04
Validation auc = 0.717380
Epoch 1965
Loss = 5.0686e-02, PNorm = 225.1292, GNorm = 0.9641, lr_0 = 9.9897e-04
Validation auc = 0.710087
Epoch 1966
Loss = 2.3223e-02, PNorm = 225.2325, GNorm = 0.4918, lr_0 = 9.9897e-04
Validation auc = 0.709851
Epoch 1967
Loss = 2.0515e-02, PNorm = 225.3225, GNorm = 0.1365, lr_0 = 9.9897e-04
Validation auc = 0.707184
Epoch 1968
Loss = 2.1879e-02, PNorm = 225.4033, GNorm = 0.9910, lr_0 = 9.9897e-04
Validation auc = 0.710545
Epoch 1969
Loss = 1.1676e-02, PNorm = 225.4775, GNorm = 0.3746, lr_0 = 9.9897e-04
Loss = 3.3738e-02, PNorm = 225.5404, GNorm = 0.2706, lr_0 = 9.9897e-04
Validation auc = 0.708605
Epoch 1970
Loss = 6.3518e-02, PNorm = 225.5982, GNorm = 0.2282, lr_0 = 9.9897e-04
Validation auc = 0.716833
Epoch 1971
Loss = 5.0456e-02, PNorm = 225.6561, GNorm = 0.4481, lr_0 = 9.9897e-04
Validation auc = 0.725801
Epoch 1972
Loss = 1.4038e-02, PNorm = 225.7073, GNorm = 0.5717, lr_0 = 9.9897e-04
Validation auc = 0.727324
Epoch 1973
Loss = 2.0193e-02, PNorm = 225.7531, GNorm = 0.7792, lr_0 = 9.9897e-04
Validation auc = 0.727477
Epoch 1974
Loss = 4.8526e-02, PNorm = 225.7887, GNorm = 1.2634, lr_0 = 9.9897e-04
Validation auc = 0.722111
Epoch 1975
Loss = 4.0381e-02, PNorm = 225.8191, GNorm = 0.1765, lr_0 = 9.9896e-04
Validation auc = 0.724493
Epoch 1976
Loss = 1.5998e-02, PNorm = 225.8557, GNorm = 1.2190, lr_0 = 9.9896e-04
Validation auc = 0.726180
Epoch 1977
Loss = 1.1919e-02, PNorm = 225.9028, GNorm = 0.7105, lr_0 = 9.9896e-04
Validation auc = 0.721410
Epoch 1978
Loss = 1.2223e-02, PNorm = 225.9465, GNorm = 0.1384, lr_0 = 9.9896e-04
Validation auc = 0.720435
Epoch 1979
Loss = 5.0561e-02, PNorm = 225.9939, GNorm = 0.9186, lr_0 = 9.9896e-04
Loss = 3.1381e-02, PNorm = 226.0441, GNorm = 0.9495, lr_0 = 9.9896e-04
Validation auc = 0.727611
Epoch 1980
Loss = 1.2716e-02, PNorm = 226.0935, GNorm = 1.4459, lr_0 = 9.9896e-04
Validation auc = 0.727494
Epoch 1981
Loss = 2.9542e-02, PNorm = 226.1387, GNorm = 0.0415, lr_0 = 9.9896e-04
Validation auc = 0.729984
Epoch 1982
Loss = 8.0323e-03, PNorm = 226.1825, GNorm = 0.0638, lr_0 = 9.9896e-04
Validation auc = 0.730081
Epoch 1983
Loss = 2.7324e-02, PNorm = 226.2205, GNorm = 0.4525, lr_0 = 9.9896e-04
Validation auc = 0.725659
Epoch 1984
Loss = 4.7307e-03, PNorm = 226.2620, GNorm = 0.0634, lr_0 = 9.9896e-04
Validation auc = 0.720434
Epoch 1985
Loss = 2.0533e-03, PNorm = 226.3045, GNorm = 0.0696, lr_0 = 9.9896e-04
Validation auc = 0.719837
Epoch 1986
Loss = 3.5745e-02, PNorm = 226.3543, GNorm = 2.4114, lr_0 = 9.9896e-04
Validation auc = 0.716813
Epoch 1987
Loss = 3.4795e-02, PNorm = 226.4311, GNorm = 0.0350, lr_0 = 9.9896e-04
Validation auc = 0.709101
Epoch 1988
Loss = 5.8019e-02, PNorm = 226.5255, GNorm = 0.0359, lr_0 = 9.9896e-04
Validation auc = 0.717075
Epoch 1989
Loss = 1.8123e-02, PNorm = 226.6056, GNorm = 0.4895, lr_0 = 9.9895e-04
Loss = 2.3168e-02, PNorm = 226.6887, GNorm = 2.3409, lr_0 = 9.9895e-04
Validation auc = 0.716532
Epoch 1990
Loss = 2.0114e-02, PNorm = 226.7667, GNorm = 0.6862, lr_0 = 9.9895e-04
Validation auc = 0.722237
Epoch 1991
Loss = 3.7456e-02, PNorm = 226.8330, GNorm = 2.9878, lr_0 = 9.9895e-04
Validation auc = 0.723888
Epoch 1992
Loss = 2.2547e-02, PNorm = 226.8987, GNorm = 0.0277, lr_0 = 9.9895e-04
Validation auc = 0.724180
Epoch 1993
Loss = 1.5953e-02, PNorm = 226.9564, GNorm = 0.2118, lr_0 = 9.9895e-04
Validation auc = 0.722087
Epoch 1994
Loss = 7.1982e-02, PNorm = 227.0045, GNorm = 2.8692, lr_0 = 9.9895e-04
Validation auc = 0.724721
Epoch 1995
Loss = 3.8808e-02, PNorm = 227.0720, GNorm = 1.7347, lr_0 = 9.9895e-04
Validation auc = 0.712493
Epoch 1996
Loss = 1.3821e-02, PNorm = 227.1515, GNorm = 0.2726, lr_0 = 9.9895e-04
Validation auc = 0.707929
Epoch 1997
Loss = 5.0132e-03, PNorm = 227.2079, GNorm = 0.1336, lr_0 = 9.9895e-04
Validation auc = 0.714194
Epoch 1998
Loss = 1.0576e-02, PNorm = 227.2584, GNorm = 0.0855, lr_0 = 9.9895e-04
Validation auc = 0.713380
Epoch 1999
Loss = 5.5801e-03, PNorm = 227.2963, GNorm = 0.1565, lr_0 = 9.9895e-04
Loss = 3.6325e-02, PNorm = 227.3386, GNorm = 0.0311, lr_0 = 9.9895e-04
Validation auc = 0.714830
Epoch 2000
Loss = 2.7005e-02, PNorm = 227.3907, GNorm = 0.2204, lr_0 = 9.9895e-04
Validation auc = 0.710749
Epoch 2001
Loss = 3.8885e-02, PNorm = 227.4387, GNorm = 0.7945, lr_0 = 9.9895e-04
Validation auc = 0.698713
Epoch 2002
Loss = 8.2724e-03, PNorm = 227.5126, GNorm = 0.2034, lr_0 = 9.9894e-04
Validation auc = 0.693859
Epoch 2003
Loss = 6.2405e-03, PNorm = 227.5909, GNorm = 0.1651, lr_0 = 9.9894e-04
Validation auc = 0.701547
Epoch 2004
Loss = 6.9085e-02, PNorm = 227.6595, GNorm = 2.8870, lr_0 = 9.9894e-04
Validation auc = 0.694639
Epoch 2005
Loss = 2.0985e-02, PNorm = 227.7462, GNorm = 2.7005, lr_0 = 9.9894e-04
Validation auc = 0.701293
Epoch 2006
Loss = 3.3995e-02, PNorm = 227.8345, GNorm = 0.4196, lr_0 = 9.9894e-04
Validation auc = 0.718375
Epoch 2007
Loss = 3.3630e-02, PNorm = 227.9285, GNorm = 2.0661, lr_0 = 9.9894e-04
Validation auc = 0.724769
Epoch 2008
Loss = 9.2711e-03, PNorm = 228.0139, GNorm = 0.6318, lr_0 = 9.9894e-04
Validation auc = 0.724171
Epoch 2009
Loss = 3.8241e-02, PNorm = 228.0791, GNorm = 2.3429, lr_0 = 9.9894e-04
Loss = 2.4610e-02, PNorm = 228.1652, GNorm = 0.1072, lr_0 = 9.9894e-04
Validation auc = 0.703584
Epoch 2010
Loss = 9.8229e-03, PNorm = 228.2383, GNorm = 0.1348, lr_0 = 9.9894e-04
Validation auc = 0.696587
Epoch 2011
Loss = 1.7524e-02, PNorm = 228.2927, GNorm = 0.8179, lr_0 = 9.9894e-04
Validation auc = 0.690059
Epoch 2012
Loss = 1.9736e-02, PNorm = 228.3508, GNorm = 1.5763, lr_0 = 9.9894e-04
Validation auc = 0.703866
Epoch 2013
Loss = 4.9266e-02, PNorm = 228.4300, GNorm = 0.5245, lr_0 = 9.9894e-04
Validation auc = 0.720299
Epoch 2014
Loss = 2.1430e-02, PNorm = 228.5319, GNorm = 0.4121, lr_0 = 9.9894e-04
Validation auc = 0.714060
Epoch 2015
Loss = 6.5677e-02, PNorm = 228.6167, GNorm = 1.1482, lr_0 = 9.9893e-04
Validation auc = 0.702584
Epoch 2016
Loss = 3.3132e-02, PNorm = 228.6994, GNorm = 0.8719, lr_0 = 9.9893e-04
Validation auc = 0.696186
Epoch 2017
Loss = 1.3138e-02, PNorm = 228.7898, GNorm = 0.5074, lr_0 = 9.9893e-04
Validation auc = 0.694070
Epoch 2018
Loss = 2.6281e-03, PNorm = 228.8661, GNorm = 0.1922, lr_0 = 9.9893e-04
Validation auc = 0.687403
Epoch 2019
Loss = 4.4474e-03, PNorm = 228.9266, GNorm = 0.0972, lr_0 = 9.9893e-04
Loss = 3.9288e-02, PNorm = 229.0097, GNorm = 2.8672, lr_0 = 9.9893e-04
Validation auc = 0.701402
Epoch 2020
Loss = 1.5001e-02, PNorm = 229.0946, GNorm = 0.0715, lr_0 = 9.9893e-04
Validation auc = 0.709212
Epoch 2021
Loss = 3.2925e-02, PNorm = 229.1699, GNorm = 1.2286, lr_0 = 9.9893e-04
Validation auc = 0.696104
Epoch 2022
Loss = 1.2488e-02, PNorm = 229.2373, GNorm = 0.7389, lr_0 = 9.9893e-04
Validation auc = 0.693438
Epoch 2023
Loss = 2.1852e-02, PNorm = 229.2924, GNorm = 0.7743, lr_0 = 9.9893e-04
Validation auc = 0.700859
Epoch 2024
Loss = 7.1349e-02, PNorm = 229.3478, GNorm = 3.1824, lr_0 = 9.9893e-04
Validation auc = 0.716818
Epoch 2025
Loss = 1.4275e-02, PNorm = 229.4535, GNorm = 0.1038, lr_0 = 9.9893e-04
Validation auc = 0.712111
Epoch 2026
Loss = 7.4584e-02, PNorm = 229.5494, GNorm = 0.0585, lr_0 = 9.9893e-04
Validation auc = 0.713190
Epoch 2027
Loss = 2.2957e-02, PNorm = 229.6396, GNorm = 1.2003, lr_0 = 9.9893e-04
Validation auc = 0.689702
Epoch 2028
Loss = 3.8009e-02, PNorm = 229.7287, GNorm = 2.1327, lr_0 = 9.9893e-04
Validation auc = 0.684873
Epoch 2029
Loss = 6.1524e-03, PNorm = 229.8183, GNorm = 0.1522, lr_0 = 9.9892e-04
Loss = 7.9485e-02, PNorm = 229.8830, GNorm = 0.5295, lr_0 = 9.9892e-04
Validation auc = 0.676774
Epoch 2030
Loss = 2.9675e-02, PNorm = 229.9453, GNorm = 0.5099, lr_0 = 9.9892e-04
Validation auc = 0.680616
Epoch 2031
Loss = 2.1656e-02, PNorm = 230.0165, GNorm = 0.3114, lr_0 = 9.9892e-04
Validation auc = 0.677458
Epoch 2032
Loss = 5.1499e-02, PNorm = 230.0872, GNorm = 1.0084, lr_0 = 9.9892e-04
Validation auc = 0.684327
Epoch 2033
Loss = 4.0556e-02, PNorm = 230.1633, GNorm = 0.3735, lr_0 = 9.9892e-04
Validation auc = 0.696835
Epoch 2034
Loss = 9.0108e-03, PNorm = 230.2454, GNorm = 1.1939, lr_0 = 9.9892e-04
Validation auc = 0.704450
Epoch 2035
Loss = 2.3741e-02, PNorm = 230.3063, GNorm = 0.3151, lr_0 = 9.9892e-04
Validation auc = 0.703201
Epoch 2036
Loss = 4.9168e-03, PNorm = 230.3749, GNorm = 0.0766, lr_0 = 9.9892e-04
Validation auc = 0.700573
Epoch 2037
Loss = 6.4155e-03, PNorm = 230.4350, GNorm = 0.3560, lr_0 = 9.9892e-04
Validation auc = 0.701832
Epoch 2038
Loss = 3.0195e-03, PNorm = 230.4844, GNorm = 0.1808, lr_0 = 9.9892e-04
Validation auc = 0.697833
Epoch 2039
Loss = 1.5168e-03, PNorm = 230.5388, GNorm = 0.0438, lr_0 = 9.9892e-04
Loss = 1.7773e-02, PNorm = 230.6052, GNorm = 0.3580, lr_0 = 9.9892e-04
Validation auc = 0.700361
Epoch 2040
Loss = 2.3967e-02, PNorm = 230.6603, GNorm = 0.1293, lr_0 = 9.9892e-04
Validation auc = 0.699957
Epoch 2041
Loss = 2.5558e-02, PNorm = 230.7061, GNorm = 1.3539, lr_0 = 9.9891e-04
Validation auc = 0.700702
Epoch 2042
Loss = 9.6843e-03, PNorm = 230.7481, GNorm = 0.1127, lr_0 = 9.9891e-04
Validation auc = 0.696699
Epoch 2043
Loss = 2.0485e-02, PNorm = 230.7827, GNorm = 0.1393, lr_0 = 9.9891e-04
Validation auc = 0.696367
Epoch 2044
Loss = 1.9127e-02, PNorm = 230.8180, GNorm = 0.1299, lr_0 = 9.9891e-04
Validation auc = 0.693366
Epoch 2045
Loss = 5.7690e-03, PNorm = 230.8530, GNorm = 0.9168, lr_0 = 9.9891e-04
Validation auc = 0.684078
Epoch 2046
Loss = 3.1737e-02, PNorm = 230.9028, GNorm = 1.8770, lr_0 = 9.9891e-04
Validation auc = 0.674382
Epoch 2047
Loss = 7.4908e-03, PNorm = 230.9747, GNorm = 1.4204, lr_0 = 9.9891e-04
Validation auc = 0.671097
Epoch 2048
Loss = 1.1484e-01, PNorm = 231.0436, GNorm = 0.0225, lr_0 = 9.9891e-04
Validation auc = 0.676677
Epoch 2049
Loss = 1.3297e-02, PNorm = 231.1330, GNorm = 0.5053, lr_0 = 9.9891e-04
Loss = 2.3441e-02, PNorm = 231.2071, GNorm = 0.0264, lr_0 = 9.9891e-04
Validation auc = 0.676143
Epoch 2050
Loss = 3.0508e-02, PNorm = 231.2759, GNorm = 1.7358, lr_0 = 9.9891e-04
Validation auc = 0.686062
Epoch 2051
Loss = 5.7254e-02, PNorm = 231.3263, GNorm = 1.0859, lr_0 = 9.9891e-04
Validation auc = 0.691685
Epoch 2052
Loss = 2.2066e-02, PNorm = 231.3805, GNorm = 0.2151, lr_0 = 9.9891e-04
Validation auc = 0.685602
Epoch 2053
Loss = 1.7367e-02, PNorm = 231.4458, GNorm = 0.7974, lr_0 = 9.9891e-04
Validation auc = 0.680515
Epoch 2054
Loss = 2.2222e-02, PNorm = 231.4993, GNorm = 0.0990, lr_0 = 9.9891e-04
Validation auc = 0.679006
Epoch 2055
Loss = 1.6854e-02, PNorm = 231.5407, GNorm = 0.7331, lr_0 = 9.9890e-04
Validation auc = 0.683135
Epoch 2056
Loss = 1.2004e-02, PNorm = 231.5871, GNorm = 0.4660, lr_0 = 9.9890e-04
Validation auc = 0.680853
Epoch 2057
Loss = 2.3836e-02, PNorm = 231.6392, GNorm = 1.6614, lr_0 = 9.9890e-04
Validation auc = 0.683968
Epoch 2058
Loss = 2.6502e-04, PNorm = 231.7469, GNorm = 0.0107, lr_0 = 9.9890e-04
Validation auc = 0.676695
Epoch 2059
Loss = 4.6182e-03, PNorm = 231.8235, GNorm = 0.2581, lr_0 = 9.9890e-04
Loss = 6.9884e-03, PNorm = 231.8833, GNorm = 0.0379, lr_0 = 9.9890e-04
Validation auc = 0.671700
Epoch 2060
Loss = 5.0303e-02, PNorm = 231.9379, GNorm = 0.1063, lr_0 = 9.9890e-04
Validation auc = 0.672875
Epoch 2061
Loss = 2.7942e-02, PNorm = 231.9908, GNorm = 0.7829, lr_0 = 9.9890e-04
Validation auc = 0.668680
Epoch 2062
Loss = 1.7578e-02, PNorm = 232.0431, GNorm = 0.0915, lr_0 = 9.9890e-04
Validation auc = 0.659794
Epoch 2063
Loss = 2.7970e-02, PNorm = 232.1097, GNorm = 0.0565, lr_0 = 9.9890e-04
Validation auc = 0.659744
Epoch 2064
Loss = 5.9343e-02, PNorm = 232.1658, GNorm = 0.9934, lr_0 = 9.9890e-04
Validation auc = 0.654132
Epoch 2065
Loss = 2.9452e-02, PNorm = 232.2205, GNorm = 0.2540, lr_0 = 9.9890e-04
Validation auc = 0.648590
Epoch 2066
Loss = 5.7654e-03, PNorm = 232.2737, GNorm = 0.1075, lr_0 = 9.9890e-04
Validation auc = 0.643661
Epoch 2067
Loss = 4.7246e-02, PNorm = 232.3380, GNorm = 1.8550, lr_0 = 9.9890e-04
Validation auc = 0.656336
Epoch 2068
Loss = 7.9867e-02, PNorm = 232.4033, GNorm = 1.7700, lr_0 = 9.9889e-04
Validation auc = 0.666875
Epoch 2069
Loss = 8.2507e-03, PNorm = 232.4711, GNorm = 0.3644, lr_0 = 9.9889e-04
Loss = 3.0000e-02, PNorm = 232.5172, GNorm = 0.7303, lr_0 = 9.9889e-04
Validation auc = 0.671363
Epoch 2070
Loss = 2.5550e-02, PNorm = 232.5747, GNorm = 0.3617, lr_0 = 9.9889e-04
Validation auc = 0.672048
Epoch 2071
Loss = 1.5328e-02, PNorm = 232.6452, GNorm = 0.0891, lr_0 = 9.9889e-04
Validation auc = 0.670523
Epoch 2072
Loss = 3.7248e-02, PNorm = 232.7089, GNorm = 1.3945, lr_0 = 9.9889e-04
Validation auc = 0.669979
Epoch 2073
Loss = 1.8709e-02, PNorm = 232.7877, GNorm = 0.0812, lr_0 = 9.9889e-04
Validation auc = 0.666710
Epoch 2074
Loss = 5.2256e-02, PNorm = 232.8586, GNorm = 0.7949, lr_0 = 9.9889e-04
Validation auc = 0.667056
Epoch 2075
Loss = 2.1391e-02, PNorm = 232.9180, GNorm = 0.5119, lr_0 = 9.9889e-04
Validation auc = 0.672128
Epoch 2076
Loss = 3.3805e-03, PNorm = 232.9719, GNorm = 0.0578, lr_0 = 9.9889e-04
Validation auc = 0.677918
Epoch 2077
Loss = 7.0607e-03, PNorm = 233.0141, GNorm = 0.9248, lr_0 = 9.9889e-04
Validation auc = 0.689520
Epoch 2078
Loss = 5.8089e-02, PNorm = 233.0581, GNorm = 3.2773, lr_0 = 9.9889e-04
Validation auc = 0.690196
Epoch 2079
Loss = 1.6084e-03, PNorm = 233.1262, GNorm = 0.0486, lr_0 = 9.9889e-04
Loss = 2.9078e-02, PNorm = 233.2003, GNorm = 1.3098, lr_0 = 9.9889e-04
Validation auc = 0.692511
Epoch 2080
Loss = 5.1474e-02, PNorm = 233.2941, GNorm = 0.4316, lr_0 = 9.9889e-04
Validation auc = 0.695677
Epoch 2081
Loss = 5.5082e-02, PNorm = 233.3932, GNorm = 1.6501, lr_0 = 9.9888e-04
Validation auc = 0.688807
Epoch 2082
Loss = 2.8712e-02, PNorm = 233.4779, GNorm = 0.5384, lr_0 = 9.9888e-04
Validation auc = 0.692641
Epoch 2083
Loss = 4.1884e-02, PNorm = 233.5697, GNorm = 0.1097, lr_0 = 9.9888e-04
Validation auc = 0.694879
Epoch 2084
Loss = 1.2444e-02, PNorm = 233.6448, GNorm = 0.0695, lr_0 = 9.9888e-04
Validation auc = 0.700271
Epoch 2085
Loss = 3.9585e-03, PNorm = 233.7061, GNorm = 0.0390, lr_0 = 9.9888e-04
Validation auc = 0.700044
Epoch 2086
Loss = 1.7669e-02, PNorm = 233.7622, GNorm = 1.5301, lr_0 = 9.9888e-04
Validation auc = 0.697416
Epoch 2087
Loss = 6.3999e-02, PNorm = 233.8139, GNorm = 2.6098, lr_0 = 9.9888e-04
Validation auc = 0.701071
Epoch 2088
Loss = 9.4697e-02, PNorm = 233.8770, GNorm = 2.6137, lr_0 = 9.9888e-04
Validation auc = 0.704850
Epoch 2089
Loss = 6.0269e-02, PNorm = 233.9389, GNorm = 2.2712, lr_0 = 9.9888e-04
Loss = 9.1021e-02, PNorm = 234.0213, GNorm = 0.3070, lr_0 = 9.9888e-04
Validation auc = 0.698302
Epoch 2090
Loss = 2.8055e-02, PNorm = 234.1175, GNorm = 0.0603, lr_0 = 9.9888e-04
Validation auc = 0.690005
Epoch 2091
Loss = 4.4490e-02, PNorm = 234.1958, GNorm = 0.3625, lr_0 = 9.9888e-04
Validation auc = 0.689329
Epoch 2092
Loss = 4.9587e-02, PNorm = 234.2736, GNorm = 1.1286, lr_0 = 9.9888e-04
Validation auc = 0.707106
Epoch 2093
Loss = 3.8769e-02, PNorm = 234.3639, GNorm = 1.4099, lr_0 = 9.9888e-04
Validation auc = 0.722360
Epoch 2094
Loss = 3.6981e-02, PNorm = 234.4445, GNorm = 1.0024, lr_0 = 9.9887e-04
Validation auc = 0.715648
Epoch 2095
Loss = 2.6140e-02, PNorm = 234.5154, GNorm = 0.0632, lr_0 = 9.9887e-04
Validation auc = 0.711873
Epoch 2096
Loss = 5.5377e-02, PNorm = 234.5739, GNorm = 0.0660, lr_0 = 9.9887e-04
Validation auc = 0.703776
Epoch 2097
Loss = 2.0850e-02, PNorm = 234.6313, GNorm = 0.1933, lr_0 = 9.9887e-04
Validation auc = 0.707639
Epoch 2098
Loss = 5.5343e-03, PNorm = 234.6962, GNorm = 0.0904, lr_0 = 9.9887e-04
Validation auc = 0.706497
Epoch 2099
Loss = 1.3199e-02, PNorm = 234.7426, GNorm = 0.7443, lr_0 = 9.9887e-04
Loss = 4.1307e-02, PNorm = 234.7870, GNorm = 2.1578, lr_0 = 9.9887e-04
Validation auc = 0.711911
Epoch 2100
Loss = 5.0503e-02, PNorm = 234.8532, GNorm = 0.4987, lr_0 = 9.9887e-04
Validation auc = 0.720462
Epoch 2101
Loss = 2.3550e-02, PNorm = 234.9187, GNorm = 1.1718, lr_0 = 9.9887e-04
Validation auc = 0.723880
Epoch 2102
Loss = 2.6827e-02, PNorm = 234.9883, GNorm = 0.3900, lr_0 = 9.9887e-04
Validation auc = 0.721426
Epoch 2103
Loss = 8.0511e-02, PNorm = 235.0496, GNorm = 0.9766, lr_0 = 9.9887e-04
Validation auc = 0.721084
Epoch 2104
Loss = 4.0485e-02, PNorm = 235.1396, GNorm = 0.6677, lr_0 = 9.9887e-04
Validation auc = 0.706775
Epoch 2105
Loss = 3.6551e-02, PNorm = 235.2385, GNorm = 0.0891, lr_0 = 9.9887e-04
Validation auc = 0.699425
Epoch 2106
Loss = 2.2481e-02, PNorm = 235.3192, GNorm = 0.2623, lr_0 = 9.9887e-04
Validation auc = 0.698192
Epoch 2107
Loss = 4.6462e-02, PNorm = 235.3835, GNorm = 0.2948, lr_0 = 9.9887e-04
Validation auc = 0.696964
Epoch 2108
Loss = 1.0699e-03, PNorm = 235.4462, GNorm = 0.0355, lr_0 = 9.9886e-04
Validation auc = 0.700656
Epoch 2109
Loss = 2.0554e-02, PNorm = 235.4905, GNorm = 0.6937, lr_0 = 9.9886e-04
Loss = 4.7870e-02, PNorm = 235.5343, GNorm = 0.0310, lr_0 = 9.9886e-04
Validation auc = 0.702689
Epoch 2110
Loss = 1.8330e-02, PNorm = 235.5999, GNorm = 0.0416, lr_0 = 9.9886e-04
Validation auc = 0.699112
Epoch 2111
Loss = 2.5223e-02, PNorm = 235.6730, GNorm = 0.8217, lr_0 = 9.9886e-04
Validation auc = 0.688211
Epoch 2112
Loss = 3.4698e-02, PNorm = 235.7466, GNorm = 1.7093, lr_0 = 9.9886e-04
Validation auc = 0.681569
Epoch 2113
Loss = 1.9819e-02, PNorm = 235.8154, GNorm = 0.8576, lr_0 = 9.9886e-04
Validation auc = 0.680934
Epoch 2114
Loss = 1.0930e-02, PNorm = 235.8674, GNorm = 0.0846, lr_0 = 9.9886e-04
Validation auc = 0.689897
Epoch 2115
Loss = 5.8027e-02, PNorm = 235.9232, GNorm = 0.1095, lr_0 = 9.9886e-04
Validation auc = 0.708663
Epoch 2116
Loss = 6.4479e-02, PNorm = 235.9948, GNorm = 3.9464, lr_0 = 9.9886e-04
Validation auc = 0.711782
Epoch 2117
Loss = 6.5634e-02, PNorm = 236.0687, GNorm = 1.4601, lr_0 = 9.9886e-04
Validation auc = 0.696542
Epoch 2118
Loss = 3.0180e-03, PNorm = 236.1432, GNorm = 0.1038, lr_0 = 9.9886e-04
Validation auc = 0.697065
Epoch 2119
Loss = 7.1566e-02, PNorm = 236.2021, GNorm = 0.8549, lr_0 = 9.9886e-04
Loss = 6.0655e-03, PNorm = 236.2441, GNorm = 0.1620, lr_0 = 9.9886e-04
Validation auc = 0.693131
Epoch 2120
Loss = 2.9370e-02, PNorm = 236.2807, GNorm = 0.1041, lr_0 = 9.9885e-04
Validation auc = 0.696391
Epoch 2121
Loss = 4.5862e-02, PNorm = 236.3543, GNorm = 2.1051, lr_0 = 9.9885e-04
Validation auc = 0.696087
Epoch 2122
Loss = 3.5574e-02, PNorm = 236.4324, GNorm = 1.4759, lr_0 = 9.9885e-04
Validation auc = 0.689969
Epoch 2123
Loss = 3.3125e-02, PNorm = 236.4979, GNorm = 0.3116, lr_0 = 9.9885e-04
Validation auc = 0.695743
Epoch 2124
Loss = 6.0107e-02, PNorm = 236.5512, GNorm = 1.3715, lr_0 = 9.9885e-04
Validation auc = 0.704301
Epoch 2125
Loss = 2.5528e-02, PNorm = 236.6115, GNorm = 1.3058, lr_0 = 9.9885e-04
Validation auc = 0.702857
Epoch 2126
Loss = 2.4599e-02, PNorm = 236.6701, GNorm = 0.7528, lr_0 = 9.9885e-04
Validation auc = 0.709050
Epoch 2127
Loss = 1.5099e-02, PNorm = 236.7259, GNorm = 0.6048, lr_0 = 9.9885e-04
Validation auc = 0.704384
Epoch 2128
Loss = 3.6738e-02, PNorm = 236.7851, GNorm = 0.4172, lr_0 = 9.9885e-04
Validation auc = 0.698620
Epoch 2129
Loss = 3.3488e-03, PNorm = 236.8415, GNorm = 0.1454, lr_0 = 9.9885e-04
Loss = 3.0818e-02, PNorm = 236.8847, GNorm = 1.6046, lr_0 = 9.9885e-04
Validation auc = 0.697425
Epoch 2130
Loss = 2.8682e-02, PNorm = 236.9434, GNorm = 0.5246, lr_0 = 9.9885e-04
Validation auc = 0.695705
Epoch 2131
Loss = 3.4839e-02, PNorm = 237.0130, GNorm = 0.0242, lr_0 = 9.9885e-04
Validation auc = 0.674677
Epoch 2132
Loss = 5.0908e-02, PNorm = 237.1061, GNorm = 0.8488, lr_0 = 9.9885e-04
Validation auc = 0.674149
Epoch 2133
Loss = 5.1015e-02, PNorm = 237.2051, GNorm = 0.5850, lr_0 = 9.9885e-04
Validation auc = 0.680010
Epoch 2134
Loss = 2.9423e-02, PNorm = 237.2883, GNorm = 0.1243, lr_0 = 9.9884e-04
Validation auc = 0.684485
Epoch 2135
Loss = 3.2229e-02, PNorm = 237.3533, GNorm = 1.5774, lr_0 = 9.9884e-04
Validation auc = 0.693438
Epoch 2136
Loss = 5.2053e-03, PNorm = 237.4242, GNorm = 0.1347, lr_0 = 9.9884e-04
Validation auc = 0.696495
Epoch 2137
Loss = 4.2609e-02, PNorm = 237.4877, GNorm = 0.7318, lr_0 = 9.9884e-04
Validation auc = 0.700299
Epoch 2138
Loss = 3.8210e-03, PNorm = 237.5375, GNorm = 0.1604, lr_0 = 9.9884e-04
Validation auc = 0.701964
Epoch 2139
Loss = 1.8833e-02, PNorm = 237.5777, GNorm = 0.6645, lr_0 = 9.9884e-04
Loss = 2.7426e-02, PNorm = 237.6238, GNorm = 1.4679, lr_0 = 9.9884e-04
Validation auc = 0.701906
Epoch 2140
Loss = 1.3652e-02, PNorm = 237.6813, GNorm = 0.1861, lr_0 = 9.9884e-04
Validation auc = 0.709876
Epoch 2141
Loss = 4.4250e-03, PNorm = 237.7285, GNorm = 0.0143, lr_0 = 9.9884e-04
Validation auc = 0.707682
Epoch 2142
Loss = 1.4987e-02, PNorm = 237.7658, GNorm = 0.2910, lr_0 = 9.9884e-04
Validation auc = 0.705997
Epoch 2143
Loss = 3.0460e-02, PNorm = 237.8080, GNorm = 0.3180, lr_0 = 9.9884e-04
Validation auc = 0.713549
Epoch 2144
Loss = 2.0849e-02, PNorm = 237.8652, GNorm = 1.1243, lr_0 = 9.9884e-04
Validation auc = 0.712953
Epoch 2145
Loss = 5.2848e-02, PNorm = 237.9296, GNorm = 0.3390, lr_0 = 9.9884e-04
Validation auc = 0.705743
Epoch 2146
Loss = 1.4340e-02, PNorm = 237.9936, GNorm = 0.0960, lr_0 = 9.9884e-04
Validation auc = 0.698628
Epoch 2147
Loss = 3.2336e-02, PNorm = 238.0467, GNorm = 2.5620, lr_0 = 9.9883e-04
Validation auc = 0.690991
Epoch 2148
Loss = 1.1921e-02, PNorm = 238.1175, GNorm = 0.6747, lr_0 = 9.9883e-04
Validation auc = 0.687678
Epoch 2149
Loss = 4.5851e-02, PNorm = 238.1728, GNorm = 2.3950, lr_0 = 9.9883e-04
Loss = 1.9605e-02, PNorm = 238.2358, GNorm = 1.0772, lr_0 = 9.9883e-04
Validation auc = 0.688366
Epoch 2150
Loss = 3.0290e-02, PNorm = 238.2937, GNorm = 1.5600, lr_0 = 9.9883e-04
Validation auc = 0.695465
Epoch 2151
Loss = 4.8231e-02, PNorm = 238.3751, GNorm = 0.6834, lr_0 = 9.9883e-04
Validation auc = 0.704582
Epoch 2152
Loss = 2.0721e-02, PNorm = 238.4499, GNorm = 0.5940, lr_0 = 9.9883e-04
Validation auc = 0.708971
Epoch 2153
Loss = 1.7736e-02, PNorm = 238.5103, GNorm = 0.1905, lr_0 = 9.9883e-04
Validation auc = 0.699336
Epoch 2154
Loss = 4.6233e-03, PNorm = 238.5480, GNorm = 0.0687, lr_0 = 9.9883e-04
Validation auc = 0.694827
Epoch 2155
Loss = 9.1010e-03, PNorm = 238.5857, GNorm = 0.6053, lr_0 = 9.9883e-04
Validation auc = 0.701637
Epoch 2156
Loss = 3.2234e-02, PNorm = 238.6337, GNorm = 1.3256, lr_0 = 9.9883e-04
Validation auc = 0.709161
Epoch 2157
Loss = 3.6872e-03, PNorm = 238.6767, GNorm = 0.1111, lr_0 = 9.9883e-04
Validation auc = 0.702496
Epoch 2158
Loss = 6.1408e-02, PNorm = 238.7189, GNorm = 1.3206, lr_0 = 9.9883e-04
Validation auc = 0.709384
Epoch 2159
Loss = 8.1721e-03, PNorm = 238.7739, GNorm = 0.3995, lr_0 = 9.9883e-04
Loss = 4.3950e-02, PNorm = 238.8260, GNorm = 0.2583, lr_0 = 9.9883e-04
Validation auc = 0.713784
Epoch 2160
Loss = 4.8596e-02, PNorm = 238.8885, GNorm = 0.6519, lr_0 = 9.9882e-04
Validation auc = 0.729837
Epoch 2161
Loss = 3.4675e-02, PNorm = 238.9517, GNorm = 0.9242, lr_0 = 9.9882e-04
Validation auc = 0.725467
Epoch 2162
Loss = 4.0367e-02, PNorm = 239.0088, GNorm = 0.7215, lr_0 = 9.9882e-04
Validation auc = 0.732663
Epoch 2163
Loss = 2.8817e-02, PNorm = 239.0653, GNorm = 0.5481, lr_0 = 9.9882e-04
Validation auc = 0.731903
Epoch 2164
Loss = 2.0073e-02, PNorm = 239.1390, GNorm = 0.0853, lr_0 = 9.9882e-04
Validation auc = 0.727859
Epoch 2165
Loss = 2.9209e-02, PNorm = 239.2137, GNorm = 0.9635, lr_0 = 9.9882e-04
Validation auc = 0.728804
Epoch 2166
Loss = 2.0292e-02, PNorm = 239.2673, GNorm = 1.2864, lr_0 = 9.9882e-04
Validation auc = 0.723653
Epoch 2167
Loss = 1.5804e-02, PNorm = 239.3089, GNorm = 1.6087, lr_0 = 9.9882e-04
Validation auc = 0.719626
Epoch 2168
Loss = 6.1511e-02, PNorm = 239.3464, GNorm = 1.1819, lr_0 = 9.9882e-04
Validation auc = 0.720705
Epoch 2169
Loss = 2.1918e-03, PNorm = 239.3760, GNorm = 0.0992, lr_0 = 9.9882e-04
Loss = 5.0469e-03, PNorm = 239.4102, GNorm = 0.2450, lr_0 = 9.9882e-04
Validation auc = 0.719483
Epoch 2170
Loss = 2.3607e-02, PNorm = 239.4453, GNorm = 1.1705, lr_0 = 9.9882e-04
Validation auc = 0.717727
Epoch 2171
Loss = 2.9002e-02, PNorm = 239.4919, GNorm = 0.0465, lr_0 = 9.9882e-04
Validation auc = 0.721683
Epoch 2172
Loss = 2.0248e-02, PNorm = 239.5426, GNorm = 0.0655, lr_0 = 9.9882e-04
Validation auc = 0.728471
Epoch 2173
Loss = 1.5212e-02, PNorm = 239.5872, GNorm = 0.2249, lr_0 = 9.9882e-04
Validation auc = 0.724862
Epoch 2174
Loss = 1.7734e-02, PNorm = 239.6439, GNorm = 0.6488, lr_0 = 9.9881e-04
Validation auc = 0.715477
Epoch 2175
Loss = 5.9241e-02, PNorm = 239.6890, GNorm = 0.8337, lr_0 = 9.9881e-04
Validation auc = 0.702379
Epoch 2176
Loss = 5.7374e-03, PNorm = 239.7542, GNorm = 0.1452, lr_0 = 9.9881e-04
Validation auc = 0.702991
Epoch 2177
Loss = 2.4813e-02, PNorm = 239.8182, GNorm = 0.1621, lr_0 = 9.9881e-04
Validation auc = 0.692884
Epoch 2178
Loss = 1.8405e-02, PNorm = 239.8715, GNorm = 0.2623, lr_0 = 9.9881e-04
Validation auc = 0.683843
Epoch 2179
Loss = 7.2981e-03, PNorm = 239.9342, GNorm = 0.3666, lr_0 = 9.9881e-04
Loss = 5.3301e-02, PNorm = 240.0047, GNorm = 1.8294, lr_0 = 9.9881e-04
Validation auc = 0.681743
Epoch 2180
Loss = 2.4678e-02, PNorm = 240.0739, GNorm = 0.0471, lr_0 = 9.9881e-04
Validation auc = 0.687037
Epoch 2181
Loss = 3.8564e-02, PNorm = 240.1365, GNorm = 1.1226, lr_0 = 9.9881e-04
Validation auc = 0.691832
Epoch 2182
Loss = 2.1704e-02, PNorm = 240.1862, GNorm = 1.1139, lr_0 = 9.9881e-04
Validation auc = 0.692872
Epoch 2183
Loss = 3.4401e-02, PNorm = 240.2335, GNorm = 0.5335, lr_0 = 9.9881e-04
Validation auc = 0.688320
Epoch 2184
Loss = 1.3033e-02, PNorm = 240.2790, GNorm = 0.7575, lr_0 = 9.9881e-04
Validation auc = 0.690336
Epoch 2185
Loss = 7.4278e-03, PNorm = 240.3166, GNorm = 0.8497, lr_0 = 9.9881e-04
Validation auc = 0.687717
Epoch 2186
Loss = 4.0463e-02, PNorm = 240.3529, GNorm = 1.3781, lr_0 = 9.9881e-04
Validation auc = 0.678886
Epoch 2187
Loss = 1.1933e-02, PNorm = 240.4087, GNorm = 0.0680, lr_0 = 9.9880e-04
Validation auc = 0.698433
Epoch 2188
Loss = 2.6282e-02, PNorm = 240.4778, GNorm = 0.1436, lr_0 = 9.9880e-04
Validation auc = 0.688388
Epoch 2189
Loss = 4.1841e-03, PNorm = 240.5644, GNorm = 0.1448, lr_0 = 9.9880e-04
Loss = 3.6274e-02, PNorm = 240.6302, GNorm = 1.0220, lr_0 = 9.9880e-04
Validation auc = 0.687848
Epoch 2190
Loss = 3.4100e-02, PNorm = 240.6944, GNorm = 4.1458, lr_0 = 9.9880e-04
Validation auc = 0.693497
Epoch 2191
Loss = 1.6785e-02, PNorm = 240.7535, GNorm = 0.0652, lr_0 = 9.9880e-04
Validation auc = 0.701464
Epoch 2192
Loss = 4.0289e-02, PNorm = 240.8057, GNorm = 0.1606, lr_0 = 9.9880e-04
Validation auc = 0.684102
Epoch 2193
Loss = 7.7385e-03, PNorm = 240.8776, GNorm = 0.0406, lr_0 = 9.9880e-04
Validation auc = 0.676095
Epoch 2194
Loss = 3.8288e-02, PNorm = 240.9322, GNorm = 0.2166, lr_0 = 9.9880e-04
Validation auc = 0.685449
Epoch 2195
Loss = 7.2942e-03, PNorm = 240.9776, GNorm = 0.1182, lr_0 = 9.9880e-04
Validation auc = 0.698497
Epoch 2196
Loss = 7.8640e-03, PNorm = 241.0148, GNorm = 0.1474, lr_0 = 9.9880e-04
Validation auc = 0.703238
Epoch 2197
Loss = 2.2059e-02, PNorm = 241.0501, GNorm = 0.1395, lr_0 = 9.9880e-04
Validation auc = 0.700993
Epoch 2198
Loss = 1.9591e-02, PNorm = 241.0889, GNorm = 0.0246, lr_0 = 9.9880e-04
Validation auc = 0.704859
Epoch 2199
Loss = 2.9036e-03, PNorm = 241.1366, GNorm = 0.1390, lr_0 = 9.9880e-04
Loss = 3.3764e-02, PNorm = 241.1943, GNorm = 0.0629, lr_0 = 9.9880e-04
Validation auc = 0.697404
Epoch 2200
Loss = 3.6905e-02, PNorm = 241.2691, GNorm = 0.2296, lr_0 = 9.9879e-04
Validation auc = 0.692339
Epoch 2201
Loss = 1.9541e-02, PNorm = 241.3476, GNorm = 0.9416, lr_0 = 9.9879e-04
Validation auc = 0.691036
Epoch 2202
Loss = 2.2050e-02, PNorm = 241.4063, GNorm = 0.0907, lr_0 = 9.9879e-04
Validation auc = 0.685027
Epoch 2203
Loss = 2.4180e-02, PNorm = 241.4742, GNorm = 1.2715, lr_0 = 9.9879e-04
Validation auc = 0.686293
Epoch 2204
Loss = 1.9714e-02, PNorm = 241.5479, GNorm = 0.3629, lr_0 = 9.9879e-04
Validation auc = 0.684054
Epoch 2205
Loss = 1.7402e-02, PNorm = 241.6164, GNorm = 0.0751, lr_0 = 9.9879e-04
Validation auc = 0.685602
Epoch 2206
Loss = 1.7899e-02, PNorm = 241.6875, GNorm = 0.0842, lr_0 = 9.9879e-04
Validation auc = 0.682017
Epoch 2207
Loss = 2.3693e-02, PNorm = 241.7451, GNorm = 1.4822, lr_0 = 9.9879e-04
Validation auc = 0.676054
Epoch 2208
Loss = 1.2409e-02, PNorm = 241.8019, GNorm = 0.0812, lr_0 = 9.9879e-04
Validation auc = 0.671478
Epoch 2209
Loss = 3.2453e-02, PNorm = 241.8673, GNorm = 0.8301, lr_0 = 9.9879e-04
Loss = 2.6296e-02, PNorm = 241.9321, GNorm = 0.0970, lr_0 = 9.9879e-04
Validation auc = 0.661773
Epoch 2210
Loss = 2.6759e-02, PNorm = 241.9871, GNorm = 0.5503, lr_0 = 9.9879e-04
Validation auc = 0.659665
Epoch 2211
Loss = 2.5031e-02, PNorm = 242.0347, GNorm = 0.7873, lr_0 = 9.9879e-04
Validation auc = 0.664564
Epoch 2212
Loss = 5.1292e-02, PNorm = 242.1152, GNorm = 2.3786, lr_0 = 9.9879e-04
Validation auc = 0.688343
Epoch 2213
Loss = 4.6518e-02, PNorm = 242.2069, GNorm = 1.1088, lr_0 = 9.9878e-04
Validation auc = 0.690008
Epoch 2214
Loss = 1.5235e-02, PNorm = 242.2929, GNorm = 1.0186, lr_0 = 9.9878e-04
Validation auc = 0.686374
Epoch 2215
Loss = 3.1173e-02, PNorm = 242.3522, GNorm = 1.8243, lr_0 = 9.9878e-04
Validation auc = 0.683260
Epoch 2216
Loss = 2.1624e-02, PNorm = 242.3994, GNorm = 0.8790, lr_0 = 9.9878e-04
Validation auc = 0.679898
Epoch 2217
Loss = 5.2601e-02, PNorm = 242.4551, GNorm = 1.6850, lr_0 = 9.9878e-04
Validation auc = 0.694385
Epoch 2218
Loss = 6.5371e-03, PNorm = 242.5259, GNorm = 0.3533, lr_0 = 9.9878e-04
Validation auc = 0.694097
Epoch 2219
Loss = 1.1005e-01, PNorm = 242.5943, GNorm = 0.9129, lr_0 = 9.9878e-04
Loss = 1.7887e-02, PNorm = 242.6439, GNorm = 1.0910, lr_0 = 9.9878e-04
Validation auc = 0.682060
Epoch 2220
Loss = 4.5064e-02, PNorm = 242.6916, GNorm = 1.4420, lr_0 = 9.9878e-04
Validation auc = 0.683368
Epoch 2221
Loss = 3.7047e-02, PNorm = 242.7599, GNorm = 1.5395, lr_0 = 9.9878e-04
Validation auc = 0.679031
Epoch 2222
Loss = 3.0511e-02, PNorm = 242.8454, GNorm = 0.7303, lr_0 = 9.9878e-04
Validation auc = 0.676478
Epoch 2223
Loss = 3.4402e-02, PNorm = 242.9294, GNorm = 0.1209, lr_0 = 9.9878e-04
Validation auc = 0.666045
Epoch 2224
Loss = 9.7086e-03, PNorm = 243.0004, GNorm = 0.2802, lr_0 = 9.9878e-04
Validation auc = 0.667483
Epoch 2225
Loss = 2.3371e-02, PNorm = 243.0522, GNorm = 0.2717, lr_0 = 9.9878e-04
Validation auc = 0.679426
Epoch 2226
Loss = 8.2402e-03, PNorm = 243.1118, GNorm = 0.0800, lr_0 = 9.9878e-04
Validation auc = 0.684302
Epoch 2227
Loss = 6.7144e-02, PNorm = 243.1678, GNorm = 1.3466, lr_0 = 9.9877e-04
Validation auc = 0.693985
Epoch 2228
Loss = 1.9910e-02, PNorm = 243.2247, GNorm = 1.1114, lr_0 = 9.9877e-04
Validation auc = 0.691328
Epoch 2229
Loss = 1.7480e-02, PNorm = 243.2886, GNorm = 0.7260, lr_0 = 9.9877e-04
Loss = 2.8167e-02, PNorm = 243.3520, GNorm = 1.5019, lr_0 = 9.9877e-04
Validation auc = 0.682703
Epoch 2230
Loss = 2.3196e-02, PNorm = 243.4490, GNorm = 0.0656, lr_0 = 9.9877e-04
Validation auc = 0.668245
Epoch 2231
Loss = 9.5367e-03, PNorm = 243.5160, GNorm = 1.3171, lr_0 = 9.9877e-04
Validation auc = 0.671660
Epoch 2232
Loss = 4.8293e-03, PNorm = 243.5680, GNorm = 1.0689, lr_0 = 9.9877e-04
Validation auc = 0.687349
Epoch 2233
Loss = 7.2410e-03, PNorm = 243.6070, GNorm = 0.7572, lr_0 = 9.9877e-04
Validation auc = 0.687735
Epoch 2234
Loss = 4.2841e-02, PNorm = 243.6462, GNorm = 0.0182, lr_0 = 9.9877e-04
Validation auc = 0.690391
Epoch 2235
Loss = 3.9989e-02, PNorm = 243.7505, GNorm = 2.0335, lr_0 = 9.9877e-04
Validation auc = 0.697549
Epoch 2236
Loss = 1.8677e-02, PNorm = 243.8451, GNorm = 0.8706, lr_0 = 9.9877e-04
Validation auc = 0.714452
Epoch 2237
Loss = 3.1724e-02, PNorm = 243.9438, GNorm = 0.1041, lr_0 = 9.9877e-04
Validation auc = 0.717536
Epoch 2238
Loss = 2.2183e-02, PNorm = 244.0387, GNorm = 0.8187, lr_0 = 9.9877e-04
Validation auc = 0.710593
Epoch 2239
Loss = 2.3385e-03, PNorm = 244.1234, GNorm = 0.0742, lr_0 = 9.9877e-04
Loss = 1.5649e-02, PNorm = 244.1951, GNorm = 0.1966, lr_0 = 9.9876e-04
Validation auc = 0.715827
Epoch 2240
Loss = 3.6517e-02, PNorm = 244.2525, GNorm = 0.9576, lr_0 = 9.9876e-04
Validation auc = 0.713934
Epoch 2241
Loss = 3.6977e-02, PNorm = 244.3044, GNorm = 0.9991, lr_0 = 9.9876e-04
Validation auc = 0.702916
Epoch 2242
Loss = 2.6502e-02, PNorm = 244.3674, GNorm = 0.2829, lr_0 = 9.9876e-04
Validation auc = 0.711778
Epoch 2243
Loss = 4.0987e-02, PNorm = 244.4381, GNorm = 0.2719, lr_0 = 9.9876e-04
Validation auc = 0.734809
Epoch 2244
Loss = 1.8629e-02, PNorm = 244.5053, GNorm = 0.1675, lr_0 = 9.9876e-04
Validation auc = 0.741449
Epoch 2245
Loss = 7.2271e-03, PNorm = 244.5574, GNorm = 0.0398, lr_0 = 9.9876e-04
Validation auc = 0.743066
Epoch 2246
Loss = 4.4406e-02, PNorm = 244.6049, GNorm = 0.9043, lr_0 = 9.9876e-04
Validation auc = 0.735743
Epoch 2247
Loss = 2.9673e-02, PNorm = 244.6534, GNorm = 0.1248, lr_0 = 9.9876e-04
Validation auc = 0.742913
Epoch 2248
Loss = 4.3665e-02, PNorm = 244.7041, GNorm = 1.2508, lr_0 = 9.9876e-04
Validation auc = 0.751630
Epoch 2249
Loss = 2.1431e-02, PNorm = 244.7654, GNorm = 0.7666, lr_0 = 9.9876e-04
Loss = 1.5745e-02, PNorm = 244.8196, GNorm = 0.9079, lr_0 = 9.9876e-04
Validation auc = 0.750778
Epoch 2250
Loss = 1.6867e-02, PNorm = 244.8719, GNorm = 1.0806, lr_0 = 9.9876e-04
Validation auc = 0.751598
Epoch 2251
Loss = 4.0011e-02, PNorm = 244.9296, GNorm = 1.8155, lr_0 = 9.9876e-04
Validation auc = 0.739867
Epoch 2252
Loss = 3.6191e-02, PNorm = 244.9829, GNorm = 0.6675, lr_0 = 9.9876e-04
Validation auc = 0.738924
Epoch 2253
Loss = 2.8403e-02, PNorm = 245.0367, GNorm = 0.0811, lr_0 = 9.9875e-04
Validation auc = 0.736646
Epoch 2254
Loss = 5.7990e-02, PNorm = 245.0943, GNorm = 0.2212, lr_0 = 9.9875e-04
Validation auc = 0.733105
Epoch 2255
Loss = 2.8089e-02, PNorm = 245.1655, GNorm = 0.0912, lr_0 = 9.9875e-04
Validation auc = 0.723685
Epoch 2256
Loss = 7.0796e-03, PNorm = 245.2305, GNorm = 0.0808, lr_0 = 9.9875e-04
Validation auc = 0.727745
Epoch 2257
Loss = 1.3246e-02, PNorm = 245.2828, GNorm = 0.8076, lr_0 = 9.9875e-04
Validation auc = 0.723099
Epoch 2258
Loss = 3.8475e-02, PNorm = 245.3416, GNorm = 0.1523, lr_0 = 9.9875e-04
Validation auc = 0.718274
Epoch 2259
Loss = 3.3450e-02, PNorm = 245.4071, GNorm = 1.5581, lr_0 = 9.9875e-04
Loss = 2.8605e-02, PNorm = 245.4715, GNorm = 0.1819, lr_0 = 9.9875e-04
Validation auc = 0.716065
Epoch 2260
Loss = 1.4164e-02, PNorm = 245.5214, GNorm = 0.0833, lr_0 = 9.9875e-04
Validation auc = 0.711459
Epoch 2261
Loss = 2.7778e-02, PNorm = 245.5599, GNorm = 1.6714, lr_0 = 9.9875e-04
Validation auc = 0.720335
Epoch 2262
Loss = 2.1958e-02, PNorm = 245.5995, GNorm = 0.2291, lr_0 = 9.9875e-04
Validation auc = 0.716021
Epoch 2263
Loss = 3.4132e-02, PNorm = 245.6528, GNorm = 0.0434, lr_0 = 9.9875e-04
Validation auc = 0.722397
Epoch 2264
Loss = 2.7470e-02, PNorm = 245.7149, GNorm = 1.5379, lr_0 = 9.9875e-04
Validation auc = 0.722207
Epoch 2265
Loss = 3.4627e-02, PNorm = 245.7831, GNorm = 2.9843, lr_0 = 9.9875e-04
Validation auc = 0.721231
Epoch 2266
Loss = 8.2835e-03, PNorm = 245.8409, GNorm = 0.2700, lr_0 = 9.9874e-04
Validation auc = 0.719399
Epoch 2267
Loss = 1.0401e-01, PNorm = 245.8972, GNorm = 0.1181, lr_0 = 9.9874e-04
Validation auc = 0.718739
Epoch 2268
Loss = 2.1089e-02, PNorm = 245.9429, GNorm = 1.7274, lr_0 = 9.9874e-04
Validation auc = 0.725546
Epoch 2269
Loss = 1.3837e-01, PNorm = 246.0137, GNorm = 1.3852, lr_0 = 9.9874e-04
Loss = 3.3530e-02, PNorm = 246.1035, GNorm = 0.7362, lr_0 = 9.9874e-04
Validation auc = 0.720175
Epoch 2270
Loss = 4.3319e-02, PNorm = 246.1669, GNorm = 0.8727, lr_0 = 9.9874e-04
Validation auc = 0.714583
Epoch 2271
Loss = 2.9949e-02, PNorm = 246.2234, GNorm = 1.5829, lr_0 = 9.9874e-04
Validation auc = 0.718987
Epoch 2272
Loss = 2.2850e-02, PNorm = 246.2849, GNorm = 0.0636, lr_0 = 9.9874e-04
Validation auc = 0.730266
Epoch 2273
Loss = 1.4839e-02, PNorm = 246.3418, GNorm = 1.1742, lr_0 = 9.9874e-04
Validation auc = 0.730255
Epoch 2274
Loss = 1.7482e-02, PNorm = 246.3863, GNorm = 1.2212, lr_0 = 9.9874e-04
Validation auc = 0.733041
Epoch 2275
Loss = 2.3717e-03, PNorm = 246.4269, GNorm = 0.5341, lr_0 = 9.9874e-04
Validation auc = 0.733861
Epoch 2276
Loss = 6.7272e-03, PNorm = 246.4669, GNorm = 0.3833, lr_0 = 9.9874e-04
Validation auc = 0.728545
Epoch 2277
Loss = 5.3312e-02, PNorm = 246.5073, GNorm = 0.4441, lr_0 = 9.9874e-04
Validation auc = 0.727858
Epoch 2278
Loss = 5.5666e-02, PNorm = 246.5495, GNorm = 1.1215, lr_0 = 9.9874e-04
Validation auc = 0.729608
Epoch 2279
Loss = 4.9783e-03, PNorm = 246.5911, GNorm = 0.2051, lr_0 = 9.9874e-04
Loss = 1.3876e-02, PNorm = 246.6323, GNorm = 0.0365, lr_0 = 9.9873e-04
Validation auc = 0.719517
Epoch 2280
Loss = 3.0115e-02, PNorm = 246.6975, GNorm = 0.2532, lr_0 = 9.9873e-04
Validation auc = 0.710634
Epoch 2281
Loss = 2.2680e-02, PNorm = 246.7628, GNorm = 1.6867, lr_0 = 9.9873e-04
Validation auc = 0.718921
Epoch 2282
Loss = 4.6313e-02, PNorm = 246.8109, GNorm = 2.4620, lr_0 = 9.9873e-04
Validation auc = 0.724667
Epoch 2283
Loss = 1.4041e-02, PNorm = 246.8582, GNorm = 0.2474, lr_0 = 9.9873e-04
Validation auc = 0.723221
Epoch 2284
Loss = 5.2043e-03, PNorm = 246.9005, GNorm = 0.3621, lr_0 = 9.9873e-04
Validation auc = 0.727544
Epoch 2285
Loss = 1.1469e-02, PNorm = 246.9433, GNorm = 1.0953, lr_0 = 9.9873e-04
Validation auc = 0.722869
Epoch 2286
Loss = 1.5199e-02, PNorm = 246.9904, GNorm = 0.9854, lr_0 = 9.9873e-04
Validation auc = 0.722225
Epoch 2287
Loss = 2.3940e-02, PNorm = 247.0362, GNorm = 1.2331, lr_0 = 9.9873e-04
Validation auc = 0.725736
Epoch 2288
Loss = 2.9770e-02, PNorm = 247.0753, GNorm = 0.7727, lr_0 = 9.9873e-04
Validation auc = 0.728885
Epoch 2289
Loss = 3.7102e-02, PNorm = 247.1279, GNorm = 1.1879, lr_0 = 9.9873e-04
Loss = 2.4126e-02, PNorm = 247.1880, GNorm = 1.3722, lr_0 = 9.9873e-04
Validation auc = 0.732826
Epoch 2290
Loss = 8.5527e-02, PNorm = 247.2766, GNorm = 2.7717, lr_0 = 9.9873e-04
Validation auc = 0.736187
Epoch 2291
Loss = 4.1988e-02, PNorm = 247.3837, GNorm = 1.1026, lr_0 = 9.9873e-04
Validation auc = 0.722816
Epoch 2292
Loss = 6.5100e-02, PNorm = 247.4809, GNorm = 1.0583, lr_0 = 9.9872e-04
Validation auc = 0.715585
Epoch 2293
Loss = 3.1662e-02, PNorm = 247.5814, GNorm = 0.4944, lr_0 = 9.9872e-04
Validation auc = 0.723576
Epoch 2294
Loss = 2.1889e-02, PNorm = 247.6629, GNorm = 0.6947, lr_0 = 9.9872e-04
Validation auc = 0.721452
Epoch 2295
Loss = 2.7133e-02, PNorm = 247.7226, GNorm = 1.0605, lr_0 = 9.9872e-04
Validation auc = 0.716744
Epoch 2296
Loss = 5.5508e-02, PNorm = 247.7912, GNorm = 1.7949, lr_0 = 9.9872e-04
Validation auc = 0.711781
Epoch 2297
Loss = 5.4834e-03, PNorm = 247.8552, GNorm = 0.0940, lr_0 = 9.9872e-04
Validation auc = 0.715561
Epoch 2298
Loss = 5.3601e-03, PNorm = 247.8998, GNorm = 0.3020, lr_0 = 9.9872e-04
Validation auc = 0.717055
Epoch 2299
Loss = 2.9497e-03, PNorm = 247.9343, GNorm = 0.0810, lr_0 = 9.9872e-04
Loss = 2.4196e-02, PNorm = 247.9631, GNorm = 0.6255, lr_0 = 9.9872e-04
Validation auc = 0.715287
Epoch 2300
Loss = 1.6995e-02, PNorm = 247.9931, GNorm = 0.5413, lr_0 = 9.9872e-04
Validation auc = 0.711407
Epoch 2301
Loss = 2.5514e-02, PNorm = 248.0289, GNorm = 2.7367, lr_0 = 9.9872e-04
Validation auc = 0.714639
Epoch 2302
Loss = 1.8421e-02, PNorm = 248.0765, GNorm = 2.0734, lr_0 = 9.9872e-04
Validation auc = 0.716163
Epoch 2303
Loss = 3.8740e-03, PNorm = 248.1425, GNorm = 0.3636, lr_0 = 9.9872e-04
Validation auc = 0.710972
Epoch 2304
Loss = 1.1972e-02, PNorm = 248.2025, GNorm = 0.0187, lr_0 = 9.9872e-04
Validation auc = 0.701912
Epoch 2305
Loss = 2.7744e-02, PNorm = 248.2739, GNorm = 0.9220, lr_0 = 9.9872e-04
Validation auc = 0.701604
Epoch 2306
Loss = 2.1570e-02, PNorm = 248.3458, GNorm = 0.2616, lr_0 = 9.9871e-04
Validation auc = 0.708351
Epoch 2307
Loss = 5.7055e-02, PNorm = 248.4031, GNorm = 3.4167, lr_0 = 9.9871e-04
Validation auc = 0.708469
Epoch 2308
Loss = 4.3604e-04, PNorm = 248.4862, GNorm = 0.0298, lr_0 = 9.9871e-04
Validation auc = 0.710949
Epoch 2309
Loss = 5.6786e-02, PNorm = 248.5566, GNorm = 1.8467, lr_0 = 9.9871e-04
Loss = 3.8255e-02, PNorm = 248.6191, GNorm = 0.5352, lr_0 = 9.9871e-04
Validation auc = 0.707641
Epoch 2310
Loss = 2.4736e-02, PNorm = 248.6750, GNorm = 0.3633, lr_0 = 9.9871e-04
Validation auc = 0.707570
Epoch 2311
Loss = 2.4114e-02, PNorm = 248.7378, GNorm = 0.0664, lr_0 = 9.9871e-04
Validation auc = 0.709594
Epoch 2312
Loss = 2.0363e-02, PNorm = 248.8071, GNorm = 1.4054, lr_0 = 9.9871e-04
Validation auc = 0.710683
Epoch 2313
Loss = 3.2625e-02, PNorm = 248.8764, GNorm = 0.3250, lr_0 = 9.9871e-04
Validation auc = 0.722996
Epoch 2314
Loss = 3.3112e-02, PNorm = 248.9403, GNorm = 0.1338, lr_0 = 9.9871e-04
Validation auc = 0.731815
Epoch 2315
Loss = 7.4108e-02, PNorm = 249.0070, GNorm = 1.2226, lr_0 = 9.9871e-04
Validation auc = 0.727328
Epoch 2316
Loss = 9.0259e-03, PNorm = 249.0886, GNorm = 0.1392, lr_0 = 9.9871e-04
Validation auc = 0.719416
Epoch 2317
Loss = 1.0419e-02, PNorm = 249.1532, GNorm = 1.3320, lr_0 = 9.9871e-04
Validation auc = 0.705017
Epoch 2318
Loss = 1.4675e-02, PNorm = 249.2071, GNorm = 0.2164, lr_0 = 9.9871e-04
Validation auc = 0.695672
Epoch 2319
Loss = 2.4744e-03, PNorm = 249.2467, GNorm = 0.0931, lr_0 = 9.9871e-04
Loss = 3.1072e-02, PNorm = 249.2886, GNorm = 0.0691, lr_0 = 9.9870e-04
Validation auc = 0.715581
Epoch 2320
Loss = 5.1369e-02, PNorm = 249.3527, GNorm = 0.3203, lr_0 = 9.9870e-04
Validation auc = 0.726527
Epoch 2321
Loss = 4.1794e-02, PNorm = 249.4195, GNorm = 0.1410, lr_0 = 9.9870e-04
Validation auc = 0.715899
Epoch 2322
Loss = 3.0418e-02, PNorm = 249.4736, GNorm = 1.3739, lr_0 = 9.9870e-04
Validation auc = 0.712043
Epoch 2323
Loss = 1.8340e-02, PNorm = 249.5133, GNorm = 0.3117, lr_0 = 9.9870e-04
Validation auc = 0.708084
Epoch 2324
Loss = 1.6420e-02, PNorm = 249.5544, GNorm = 0.3209, lr_0 = 9.9870e-04
Validation auc = 0.707815
Epoch 2325
Loss = 3.8831e-03, PNorm = 249.5911, GNorm = 0.0654, lr_0 = 9.9870e-04
Validation auc = 0.710797
Epoch 2326
Loss = 9.4914e-03, PNorm = 249.6141, GNorm = 1.8342, lr_0 = 9.9870e-04
Validation auc = 0.710640
Epoch 2327
Loss = 9.1443e-03, PNorm = 249.6360, GNorm = 0.2053, lr_0 = 9.9870e-04
Validation auc = 0.710838
Epoch 2328
Loss = 5.9133e-02, PNorm = 249.6707, GNorm = 0.4021, lr_0 = 9.9870e-04
Validation auc = 0.714717
Epoch 2329
Loss = 1.9354e-02, PNorm = 249.7131, GNorm = 0.7601, lr_0 = 9.9870e-04
Loss = 1.2662e-02, PNorm = 249.7625, GNorm = 0.2417, lr_0 = 9.9870e-04
Validation auc = 0.711299
Epoch 2330
Loss = 2.4364e-02, PNorm = 249.8099, GNorm = 1.0101, lr_0 = 9.9870e-04
Validation auc = 0.709829
Epoch 2331
Loss = 5.4790e-02, PNorm = 249.8828, GNorm = 0.1419, lr_0 = 9.9870e-04
Validation auc = 0.713868
Epoch 2332
Loss = 2.0032e-02, PNorm = 249.9755, GNorm = 0.4246, lr_0 = 9.9869e-04
Validation auc = 0.703050
Epoch 2333
Loss = 1.2868e-02, PNorm = 250.0411, GNorm = 1.1191, lr_0 = 9.9869e-04
Validation auc = 0.702167
Epoch 2334
Loss = 6.3405e-02, PNorm = 250.0982, GNorm = 1.8727, lr_0 = 9.9869e-04
Validation auc = 0.695976
Epoch 2335
Loss = 1.7607e-02, PNorm = 250.1622, GNorm = 0.2882, lr_0 = 9.9869e-04
Validation auc = 0.703655
Epoch 2336
Loss = 1.0235e-02, PNorm = 250.2507, GNorm = 0.1200, lr_0 = 9.9869e-04
Validation auc = 0.712076
Epoch 2337
Loss = 5.9220e-02, PNorm = 250.3313, GNorm = 3.2468, lr_0 = 9.9869e-04
Validation auc = 0.719884
Epoch 2338
Loss = 3.0840e-03, PNorm = 250.4169, GNorm = 0.1070, lr_0 = 9.9869e-04
Validation auc = 0.728320
Epoch 2339
Loss = 8.5935e-03, PNorm = 250.4820, GNorm = 0.3488, lr_0 = 9.9869e-04
Loss = 1.7105e-02, PNorm = 250.5477, GNorm = 0.1142, lr_0 = 9.9869e-04
Validation auc = 0.726789
Epoch 2340
Loss = 4.1068e-02, PNorm = 250.5941, GNorm = 0.0703, lr_0 = 9.9869e-04
Validation auc = 0.732257
Epoch 2341
Loss = 3.8722e-02, PNorm = 250.6384, GNorm = 0.1148, lr_0 = 9.9869e-04
Validation auc = 0.732295
Epoch 2342
Loss = 4.3209e-02, PNorm = 250.6924, GNorm = 0.1936, lr_0 = 9.9869e-04
Validation auc = 0.738332
Epoch 2343
Loss = 3.3250e-02, PNorm = 250.7541, GNorm = 0.2531, lr_0 = 9.9869e-04
Validation auc = 0.735054
Epoch 2344
Loss = 4.0344e-02, PNorm = 250.8165, GNorm = 0.7196, lr_0 = 9.9869e-04
Validation auc = 0.727720
Epoch 2345
Loss = 1.3106e-02, PNorm = 250.8898, GNorm = 0.1096, lr_0 = 9.9869e-04
Validation auc = 0.723750
Epoch 2346
Loss = 3.6450e-02, PNorm = 250.9687, GNorm = 2.0243, lr_0 = 9.9868e-04
Validation auc = 0.727915
Epoch 2347
Loss = 2.4448e-02, PNorm = 251.0431, GNorm = 1.1179, lr_0 = 9.9868e-04
Validation auc = 0.727425
Epoch 2348
Loss = 1.5922e-02, PNorm = 251.1028, GNorm = 0.4709, lr_0 = 9.9868e-04
Validation auc = 0.733232
Epoch 2349
Loss = 1.1651e-02, PNorm = 251.1818, GNorm = 0.2802, lr_0 = 9.9868e-04
Loss = 2.4205e-02, PNorm = 251.2459, GNorm = 0.1040, lr_0 = 9.9868e-04
Validation auc = 0.719958
Epoch 2350
Loss = 2.0568e-02, PNorm = 251.2920, GNorm = 3.2345, lr_0 = 9.9868e-04
Validation auc = 0.710532
Epoch 2351
Loss = 4.3412e-02, PNorm = 251.3423, GNorm = 0.9993, lr_0 = 9.9868e-04
Validation auc = 0.708826
Epoch 2352
Loss = 2.2540e-02, PNorm = 251.3879, GNorm = 0.5617, lr_0 = 9.9868e-04
Validation auc = 0.703589
Epoch 2353
Loss = 4.0513e-02, PNorm = 251.4295, GNorm = 0.5620, lr_0 = 9.9868e-04
Validation auc = 0.702825
Epoch 2354
Loss = 1.4451e-02, PNorm = 251.4831, GNorm = 0.2177, lr_0 = 9.9868e-04
Validation auc = 0.704950
Epoch 2355
Loss = 1.2347e-02, PNorm = 251.5234, GNorm = 1.3733, lr_0 = 9.9868e-04
Validation auc = 0.699880
Epoch 2356
Loss = 4.4449e-02, PNorm = 251.5576, GNorm = 1.1184, lr_0 = 9.9868e-04
Validation auc = 0.703903
Epoch 2357
Loss = 2.1377e-02, PNorm = 251.6088, GNorm = 0.4266, lr_0 = 9.9868e-04
Validation auc = 0.704580
Epoch 2358
Loss = 1.0576e-01, PNorm = 251.6606, GNorm = 1.7365, lr_0 = 9.9868e-04
Validation auc = 0.704648
Epoch 2359
Loss = 2.0974e-03, PNorm = 251.7237, GNorm = 0.0642, lr_0 = 9.9867e-04
Loss = 2.1118e-02, PNorm = 251.7908, GNorm = 0.5360, lr_0 = 9.9867e-04
Validation auc = 0.703429
Epoch 2360
Loss = 2.4901e-02, PNorm = 251.8520, GNorm = 0.6458, lr_0 = 9.9867e-04
Validation auc = 0.698146
Epoch 2361
Loss = 1.9276e-02, PNorm = 251.9008, GNorm = 0.3679, lr_0 = 9.9867e-04
Validation auc = 0.702090
Epoch 2362
Loss = 1.3052e-02, PNorm = 251.9433, GNorm = 0.0300, lr_0 = 9.9867e-04
Validation auc = 0.704975
Epoch 2363
Loss = 2.6286e-02, PNorm = 251.9900, GNorm = 1.4827, lr_0 = 9.9867e-04
Validation auc = 0.704023
Epoch 2364
Loss = 3.9909e-02, PNorm = 252.0450, GNorm = 1.1313, lr_0 = 9.9867e-04
Validation auc = 0.698767
Epoch 2365
Loss = 9.9322e-03, PNorm = 252.0934, GNorm = 1.3717, lr_0 = 9.9867e-04
Validation auc = 0.692426
Epoch 2366
Loss = 4.2832e-03, PNorm = 252.1392, GNorm = 0.9887, lr_0 = 9.9867e-04
Validation auc = 0.690079
Epoch 2367
Loss = 2.0308e-02, PNorm = 252.1802, GNorm = 0.2784, lr_0 = 9.9867e-04
Validation auc = 0.687166
Epoch 2368
Loss = 6.2455e-02, PNorm = 252.2407, GNorm = 1.2534, lr_0 = 9.9867e-04
Validation auc = 0.705603
Epoch 2369
Loss = 1.3348e-01, PNorm = 252.3211, GNorm = 3.0040, lr_0 = 9.9867e-04
Loss = 1.6695e-02, PNorm = 252.4015, GNorm = 0.1485, lr_0 = 9.9867e-04
Validation auc = 0.714566
Epoch 2370
Loss = 2.3997e-02, PNorm = 252.4660, GNorm = 0.3036, lr_0 = 9.9867e-04
Validation auc = 0.715283
Epoch 2371
Loss = 1.4301e-02, PNorm = 252.5123, GNorm = 0.0686, lr_0 = 9.9867e-04
Validation auc = 0.709413
Epoch 2372
Loss = 2.8688e-02, PNorm = 252.5725, GNorm = 0.1990, lr_0 = 9.9866e-04
Validation auc = 0.710418
Epoch 2373
Loss = 2.9218e-02, PNorm = 252.6414, GNorm = 0.2702, lr_0 = 9.9866e-04
Validation auc = 0.705066
Epoch 2374
Loss = 3.6925e-02, PNorm = 252.7001, GNorm = 1.0393, lr_0 = 9.9866e-04
Validation auc = 0.702102
Epoch 2375
Loss = 6.1937e-02, PNorm = 252.7446, GNorm = 0.3440, lr_0 = 9.9866e-04
Validation auc = 0.702582
Epoch 2376
Loss = 1.3007e-02, PNorm = 252.8027, GNorm = 0.0970, lr_0 = 9.9866e-04
Validation auc = 0.705028
Epoch 2377
Loss = 1.8401e-02, PNorm = 252.8503, GNorm = 1.8378, lr_0 = 9.9866e-04
Validation auc = 0.707600
Epoch 2378
Loss = 1.3306e-02, PNorm = 252.8903, GNorm = 0.0545, lr_0 = 9.9866e-04
Validation auc = 0.705643
Epoch 2379
Loss = 1.1816e-02, PNorm = 252.9229, GNorm = 0.7894, lr_0 = 9.9866e-04
Loss = 6.9563e-02, PNorm = 252.9705, GNorm = 3.9839, lr_0 = 9.9866e-04
Validation auc = 0.698632
Epoch 2380
Loss = 3.5127e-02, PNorm = 253.0436, GNorm = 1.0517, lr_0 = 9.9866e-04
Validation auc = 0.695598
Epoch 2381
Loss = 3.0748e-02, PNorm = 253.1118, GNorm = 0.7485, lr_0 = 9.9866e-04
Validation auc = 0.689173
Epoch 2382
Loss = 2.6091e-02, PNorm = 253.1683, GNorm = 0.1086, lr_0 = 9.9866e-04
Validation auc = 0.689843
Epoch 2383
Loss = 5.1777e-02, PNorm = 253.2297, GNorm = 0.1753, lr_0 = 9.9866e-04
Validation auc = 0.696020
Epoch 2384
Loss = 3.4402e-02, PNorm = 253.2914, GNorm = 2.3510, lr_0 = 9.9866e-04
Validation auc = 0.691169
Epoch 2385
Loss = 5.1788e-02, PNorm = 253.3714, GNorm = 2.6400, lr_0 = 9.9865e-04
Validation auc = 0.681643
Epoch 2386
Loss = 6.5222e-02, PNorm = 253.4528, GNorm = 2.6015, lr_0 = 9.9865e-04
Validation auc = 0.687278
Epoch 2387
Loss = 8.4505e-03, PNorm = 253.5443, GNorm = 0.1441, lr_0 = 9.9865e-04
Validation auc = 0.696543
Epoch 2388
Loss = 4.6024e-03, PNorm = 253.6249, GNorm = 0.2428, lr_0 = 9.9865e-04
Validation auc = 0.698020
Epoch 2389
Loss = 4.0967e-02, PNorm = 253.7057, GNorm = 1.1093, lr_0 = 9.9865e-04
Loss = 3.2759e-02, PNorm = 253.7900, GNorm = 0.4374, lr_0 = 9.9865e-04
Validation auc = 0.694913
Epoch 2390
Loss = 2.6950e-02, PNorm = 253.8711, GNorm = 0.8418, lr_0 = 9.9865e-04
Validation auc = 0.704161
Epoch 2391
Loss = 2.1128e-02, PNorm = 253.9377, GNorm = 0.3815, lr_0 = 9.9865e-04
Validation auc = 0.707103
Epoch 2392
Loss = 1.8410e-02, PNorm = 253.9920, GNorm = 0.0365, lr_0 = 9.9865e-04
Validation auc = 0.699376
Epoch 2393
Loss = 1.6856e-02, PNorm = 254.0436, GNorm = 0.4725, lr_0 = 9.9865e-04
Validation auc = 0.689816
Epoch 2394
Loss = 1.6605e-02, PNorm = 254.0874, GNorm = 0.9668, lr_0 = 9.9865e-04
Validation auc = 0.691290
Epoch 2395
Loss = 3.1357e-02, PNorm = 254.1314, GNorm = 1.5764, lr_0 = 9.9865e-04
Validation auc = 0.694059
Epoch 2396
Loss = 3.3594e-02, PNorm = 254.1904, GNorm = 1.0015, lr_0 = 9.9865e-04
Validation auc = 0.694054
Epoch 2397
Loss = 1.3613e-02, PNorm = 254.2507, GNorm = 0.8911, lr_0 = 9.9865e-04
Validation auc = 0.688095
Epoch 2398
Loss = 6.5978e-02, PNorm = 254.2979, GNorm = 1.5074, lr_0 = 9.9865e-04
Validation auc = 0.681977
Epoch 2399
Loss = 1.9299e-03, PNorm = 254.3416, GNorm = 0.0645, lr_0 = 9.9864e-04
Loss = 2.5288e-02, PNorm = 254.3893, GNorm = 1.1829, lr_0 = 9.9864e-04
Validation auc = 0.687650
Epoch 2400
Loss = 2.8369e-02, PNorm = 254.4377, GNorm = 0.4029, lr_0 = 9.9864e-04
Validation auc = 0.691548
Epoch 2401
Loss = 3.1649e-02, PNorm = 254.4904, GNorm = 1.2546, lr_0 = 9.9864e-04
Validation auc = 0.696305
Epoch 2402
Loss = 3.4577e-02, PNorm = 254.5419, GNorm = 0.1804, lr_0 = 9.9864e-04
Validation auc = 0.707401
Epoch 2403
Loss = 6.6131e-02, PNorm = 254.6064, GNorm = 1.0986, lr_0 = 9.9864e-04
Validation auc = 0.707457
Epoch 2404
Loss = 2.5019e-02, PNorm = 254.6898, GNorm = 1.4135, lr_0 = 9.9864e-04
Validation auc = 0.709281
Epoch 2405
Loss = 1.9294e-02, PNorm = 254.7600, GNorm = 1.2991, lr_0 = 9.9864e-04
Validation auc = 0.709002
Epoch 2406
Loss = 4.4143e-02, PNorm = 254.8323, GNorm = 0.0985, lr_0 = 9.9864e-04
Validation auc = 0.712170
Epoch 2407
Loss = 8.0371e-03, PNorm = 254.8936, GNorm = 0.3093, lr_0 = 9.9864e-04
Validation auc = 0.713448
Epoch 2408
Loss = 5.0860e-03, PNorm = 254.9462, GNorm = 0.0725, lr_0 = 9.9864e-04
Validation auc = 0.716982
Epoch 2409
Loss = 5.6614e-02, PNorm = 254.9926, GNorm = 2.1028, lr_0 = 9.9864e-04
Loss = 1.7263e-02, PNorm = 255.0384, GNorm = 1.3663, lr_0 = 9.9864e-04
Validation auc = 0.720081
Epoch 2410
Loss = 1.9590e-02, PNorm = 255.0814, GNorm = 0.7494, lr_0 = 9.9864e-04
Validation auc = 0.723221
Epoch 2411
Loss = 1.6889e-02, PNorm = 255.1276, GNorm = 0.5630, lr_0 = 9.9863e-04
Validation auc = 0.715150
Epoch 2412
Loss = 1.1530e-02, PNorm = 255.1621, GNorm = 0.1478, lr_0 = 9.9863e-04
Validation auc = 0.709128
Epoch 2413
Loss = 3.2593e-02, PNorm = 255.1960, GNorm = 0.0885, lr_0 = 9.9863e-04
Validation auc = 0.711306
Epoch 2414
Loss = 1.5876e-02, PNorm = 255.2277, GNorm = 0.0523, lr_0 = 9.9863e-04
Validation auc = 0.711904
Epoch 2415
Loss = 2.9096e-02, PNorm = 255.2696, GNorm = 1.0492, lr_0 = 9.9863e-04
Validation auc = 0.711059
Epoch 2416
Loss = 6.5042e-03, PNorm = 255.3350, GNorm = 0.0406, lr_0 = 9.9863e-04
Validation auc = 0.714222
Epoch 2417
Loss = 6.3401e-02, PNorm = 255.3896, GNorm = 2.7277, lr_0 = 9.9863e-04
Validation auc = 0.712334
Epoch 2418
Loss = 4.1119e-02, PNorm = 255.4430, GNorm = 2.6858, lr_0 = 9.9863e-04
Validation auc = 0.706873
Epoch 2419
Loss = 8.3907e-03, PNorm = 255.5058, GNorm = 0.2528, lr_0 = 9.9863e-04
Loss = 2.7360e-02, PNorm = 255.5599, GNorm = 0.2088, lr_0 = 9.9863e-04
Validation auc = 0.705509
Epoch 2420
Loss = 3.0998e-02, PNorm = 255.6023, GNorm = 1.0601, lr_0 = 9.9863e-04
Validation auc = 0.705848
Epoch 2421
Loss = 2.8681e-02, PNorm = 255.6533, GNorm = 0.1307, lr_0 = 9.9863e-04
Validation auc = 0.712766
Epoch 2422
Loss = 2.8341e-02, PNorm = 255.6986, GNorm = 2.7520, lr_0 = 9.9863e-04
Validation auc = 0.718114
Epoch 2423
Loss = 3.7054e-02, PNorm = 255.7480, GNorm = 2.0739, lr_0 = 9.9863e-04
Validation auc = 0.719578
Epoch 2424
Loss = 1.5881e-02, PNorm = 255.7850, GNorm = 2.3551, lr_0 = 9.9863e-04
Validation auc = 0.721436
Epoch 2425
Loss = 4.9805e-02, PNorm = 255.8177, GNorm = 0.6948, lr_0 = 9.9862e-04
Validation auc = 0.726704
Epoch 2426
Loss = 9.5204e-03, PNorm = 255.8520, GNorm = 0.2896, lr_0 = 9.9862e-04
Validation auc = 0.724292
Epoch 2427
Loss = 9.2057e-03, PNorm = 255.8921, GNorm = 0.4865, lr_0 = 9.9862e-04
Validation auc = 0.719389
Epoch 2428
Loss = 5.0669e-02, PNorm = 255.9359, GNorm = 0.2211, lr_0 = 9.9862e-04
Validation auc = 0.716168
Epoch 2429
Loss = 1.5602e-03, PNorm = 255.9727, GNorm = 0.0776, lr_0 = 9.9862e-04
Loss = 5.2300e-02, PNorm = 256.0014, GNorm = 2.1687, lr_0 = 9.9862e-04
Validation auc = 0.710576
Epoch 2430
Loss = 2.2329e-02, PNorm = 256.0449, GNorm = 0.1740, lr_0 = 9.9862e-04
Validation auc = 0.717537
Epoch 2431
Loss = 3.5076e-02, PNorm = 256.0945, GNorm = 0.1908, lr_0 = 9.9862e-04
Validation auc = 0.714139
Epoch 2432
Loss = 4.6263e-02, PNorm = 256.1438, GNorm = 1.0182, lr_0 = 9.9862e-04
Validation auc = 0.707730
Epoch 2433
Loss = 1.6035e-02, PNorm = 256.1848, GNorm = 0.5941, lr_0 = 9.9862e-04
Validation auc = 0.711747
Epoch 2434
Loss = 8.1760e-03, PNorm = 256.2286, GNorm = 0.2675, lr_0 = 9.9862e-04
Validation auc = 0.714457
Epoch 2435
Loss = 2.1072e-02, PNorm = 256.2691, GNorm = 0.1088, lr_0 = 9.9862e-04
Validation auc = 0.707583
Epoch 2436
Loss = 2.6282e-02, PNorm = 256.3068, GNorm = 0.2087, lr_0 = 9.9862e-04
Validation auc = 0.695968
Epoch 2437
Loss = 5.3563e-02, PNorm = 256.3452, GNorm = 1.9733, lr_0 = 9.9862e-04
Validation auc = 0.699411
Epoch 2438
Loss = 2.4571e-02, PNorm = 256.4044, GNorm = 0.3373, lr_0 = 9.9861e-04
Validation auc = 0.696743
Epoch 2439
Loss = 1.3663e-02, PNorm = 256.4516, GNorm = 0.5625, lr_0 = 9.9861e-04
Loss = 3.2649e-02, PNorm = 256.5007, GNorm = 0.2233, lr_0 = 9.9861e-04
Validation auc = 0.691397
Epoch 2440
Loss = 2.7205e-02, PNorm = 256.5527, GNorm = 0.4006, lr_0 = 9.9861e-04
Validation auc = 0.692092
Epoch 2441
Loss = 1.3743e-02, PNorm = 256.5935, GNorm = 0.1475, lr_0 = 9.9861e-04
Validation auc = 0.694758
Epoch 2442
Loss = 3.7903e-02, PNorm = 256.6256, GNorm = 0.4698, lr_0 = 9.9861e-04
Validation auc = 0.701227
Epoch 2443
Loss = 3.2683e-03, PNorm = 256.6614, GNorm = 0.5046, lr_0 = 9.9861e-04
Validation auc = 0.705088
Epoch 2444
Loss = 5.9659e-02, PNorm = 256.6998, GNorm = 1.1778, lr_0 = 9.9861e-04
Validation auc = 0.696479
Epoch 2445
Loss = 9.6771e-03, PNorm = 256.7549, GNorm = 0.1000, lr_0 = 9.9861e-04
Validation auc = 0.684851
Epoch 2446
Loss = 4.0170e-02, PNorm = 256.8102, GNorm = 2.4480, lr_0 = 9.9861e-04
Validation auc = 0.698972
Epoch 2447
Loss = 1.2181e-02, PNorm = 256.8886, GNorm = 0.8295, lr_0 = 9.9861e-04
Validation auc = 0.715107
Epoch 2448
Loss = 3.3376e-03, PNorm = 256.9695, GNorm = 0.1043, lr_0 = 9.9861e-04
Validation auc = 0.719958
Epoch 2449
Loss = 2.6282e-03, PNorm = 257.0364, GNorm = 0.1027, lr_0 = 9.9861e-04
Loss = 3.1231e-02, PNorm = 257.0976, GNorm = 0.1311, lr_0 = 9.9861e-04
Validation auc = 0.721018
Epoch 2450
Loss = 2.6169e-02, PNorm = 257.1504, GNorm = 0.2386, lr_0 = 9.9861e-04
Validation auc = 0.717255
Epoch 2451
Loss = 1.6088e-02, PNorm = 257.1945, GNorm = 0.1789, lr_0 = 9.9860e-04
Validation auc = 0.713100
Epoch 2452
Loss = 4.0362e-02, PNorm = 257.2356, GNorm = 0.0793, lr_0 = 9.9860e-04
Validation auc = 0.717982
Epoch 2453
Loss = 2.4008e-02, PNorm = 257.2949, GNorm = 0.1329, lr_0 = 9.9860e-04
Validation auc = 0.713473
Epoch 2454
Loss = 1.7127e-02, PNorm = 257.3529, GNorm = 0.5662, lr_0 = 9.9860e-04
Validation auc = 0.710582
Epoch 2455
Loss = 1.1044e-02, PNorm = 257.4030, GNorm = 0.4690, lr_0 = 9.9860e-04
Validation auc = 0.706601
Epoch 2456
Loss = 2.3142e-02, PNorm = 257.4584, GNorm = 0.6203, lr_0 = 9.9860e-04
Validation auc = 0.705815
Epoch 2457
Loss = 1.2264e-03, PNorm = 257.5090, GNorm = 0.0443, lr_0 = 9.9860e-04
Validation auc = 0.697369
Epoch 2458
Loss = 4.7259e-02, PNorm = 257.5608, GNorm = 2.1039, lr_0 = 9.9860e-04
Validation auc = 0.686763
Epoch 2459
Loss = 2.7699e-02, PNorm = 257.6288, GNorm = 1.0514, lr_0 = 9.9860e-04
Loss = 2.2926e-02, PNorm = 257.7025, GNorm = 0.4664, lr_0 = 9.9860e-04
Validation auc = 0.690704
Epoch 2460
Loss = 3.7725e-02, PNorm = 257.7637, GNorm = 1.8276, lr_0 = 9.9860e-04
Validation auc = 0.698041
Epoch 2461
Loss = 2.2918e-02, PNorm = 257.8204, GNorm = 0.0766, lr_0 = 9.9860e-04
Validation auc = 0.693087
Epoch 2462
Loss = 1.6544e-02, PNorm = 257.8691, GNorm = 0.0818, lr_0 = 9.9860e-04
Validation auc = 0.679425
Epoch 2463
Loss = 1.9516e-02, PNorm = 257.9141, GNorm = 3.2263, lr_0 = 9.9860e-04
Validation auc = 0.684540
Epoch 2464
Loss = 1.6482e-02, PNorm = 257.9670, GNorm = 1.2035, lr_0 = 9.9859e-04
Validation auc = 0.690477
Epoch 2465
Loss = 4.5503e-02, PNorm = 258.0132, GNorm = 0.1353, lr_0 = 9.9859e-04
Validation auc = 0.700976
Epoch 2466
Loss = 1.2309e-02, PNorm = 258.0714, GNorm = 0.2135, lr_0 = 9.9859e-04
Validation auc = 0.704960
Epoch 2467
Loss = 5.1598e-02, PNorm = 258.1172, GNorm = 1.0884, lr_0 = 9.9859e-04
Validation auc = 0.701448
Epoch 2468
Loss = 4.0739e-02, PNorm = 258.1757, GNorm = 1.2161, lr_0 = 9.9859e-04
Validation auc = 0.711658
Epoch 2469
Loss = 8.1070e-03, PNorm = 258.2406, GNorm = 0.1853, lr_0 = 9.9859e-04
Loss = 2.6340e-02, PNorm = 258.3077, GNorm = 0.8995, lr_0 = 9.9859e-04
Validation auc = 0.727650
Epoch 2470
Loss = 2.1029e-02, PNorm = 258.3649, GNorm = 0.2244, lr_0 = 9.9859e-04
Validation auc = 0.735081
Epoch 2471
Loss = 2.0515e-02, PNorm = 258.4076, GNorm = 0.0235, lr_0 = 9.9859e-04
Validation auc = 0.736070
Epoch 2472
Loss = 2.0227e-02, PNorm = 258.4492, GNorm = 0.2993, lr_0 = 9.9859e-04
Validation auc = 0.738301
Epoch 2473
Loss = 1.4125e-02, PNorm = 258.5018, GNorm = 0.5026, lr_0 = 9.9859e-04
Validation auc = 0.738207
Epoch 2474
Loss = 1.0339e-02, PNorm = 258.5511, GNorm = 0.2058, lr_0 = 9.9859e-04
Validation auc = 0.739255
Epoch 2475
Loss = 9.8211e-02, PNorm = 258.6047, GNorm = 1.5847, lr_0 = 9.9859e-04
Validation auc = 0.731218
Epoch 2476
Loss = 9.2623e-03, PNorm = 258.6701, GNorm = 0.6121, lr_0 = 9.9859e-04
Validation auc = 0.725065
Epoch 2477
Loss = 5.2793e-03, PNorm = 258.7293, GNorm = 0.0231, lr_0 = 9.9859e-04
Validation auc = 0.723406
Epoch 2478
Loss = 3.9281e-02, PNorm = 258.7856, GNorm = 1.3741, lr_0 = 9.9858e-04
Validation auc = 0.722326
Epoch 2479
Loss = 2.2425e-03, PNorm = 258.8425, GNorm = 0.0874, lr_0 = 9.9858e-04
Loss = 3.1719e-02, PNorm = 258.8856, GNorm = 0.8435, lr_0 = 9.9858e-04
Validation auc = 0.722011
Epoch 2480
Loss = 6.8974e-03, PNorm = 258.9254, GNorm = 0.2433, lr_0 = 9.9858e-04
Validation auc = 0.724129
Epoch 2481
Loss = 3.0151e-02, PNorm = 258.9585, GNorm = 0.8933, lr_0 = 9.9858e-04
Validation auc = 0.725321
Epoch 2482
Loss = 1.7313e-02, PNorm = 258.9918, GNorm = 0.2171, lr_0 = 9.9858e-04
Validation auc = 0.724464
Epoch 2483
Loss = 4.3361e-02, PNorm = 259.0278, GNorm = 0.0722, lr_0 = 9.9858e-04
Validation auc = 0.726945
Epoch 2484
Loss = 3.9922e-02, PNorm = 259.0854, GNorm = 0.2746, lr_0 = 9.9858e-04
Validation auc = 0.736667
Epoch 2485
Loss = 2.1780e-02, PNorm = 259.1472, GNorm = 0.5242, lr_0 = 9.9858e-04
Validation auc = 0.732895
Epoch 2486
Loss = 1.6777e-02, PNorm = 259.1936, GNorm = 1.5376, lr_0 = 9.9858e-04
Validation auc = 0.730499
Epoch 2487
Loss = 4.5256e-03, PNorm = 259.2387, GNorm = 0.2788, lr_0 = 9.9858e-04
Validation auc = 0.728180
Epoch 2488
Loss = 6.1535e-03, PNorm = 259.2707, GNorm = 0.5132, lr_0 = 9.9858e-04
Validation auc = 0.728013
Epoch 2489
Loss = 1.0420e-02, PNorm = 259.3058, GNorm = 1.0802, lr_0 = 9.9858e-04
Loss = 4.8605e-02, PNorm = 259.3398, GNorm = 2.7471, lr_0 = 9.9858e-04
Validation auc = 0.732965
Epoch 2490
Loss = 1.1138e-02, PNorm = 259.3869, GNorm = 0.0308, lr_0 = 9.9858e-04
Validation auc = 0.734861
Epoch 2491
Loss = 5.6200e-02, PNorm = 259.4325, GNorm = 1.6011, lr_0 = 9.9857e-04
Validation auc = 0.728701
Epoch 2492
Loss = 2.2049e-02, PNorm = 259.4893, GNorm = 1.0210, lr_0 = 9.9857e-04
Validation auc = 0.729980
Epoch 2493
Loss = 3.6888e-02, PNorm = 259.5435, GNorm = 0.1486, lr_0 = 9.9857e-04
Validation auc = 0.730219
Epoch 2494
Loss = 3.7331e-02, PNorm = 259.5902, GNorm = 0.8534, lr_0 = 9.9857e-04
Validation auc = 0.730840
Epoch 2495
Loss = 9.8040e-03, PNorm = 259.6336, GNorm = 0.7272, lr_0 = 9.9857e-04
Validation auc = 0.745009
Epoch 2496
Loss = 2.2518e-02, PNorm = 259.6786, GNorm = 0.4233, lr_0 = 9.9857e-04
Validation auc = 0.745005
Epoch 2497
Loss = 5.9146e-02, PNorm = 259.7249, GNorm = 0.9905, lr_0 = 9.9857e-04
Validation auc = 0.728654
Epoch 2498
Loss = 8.2287e-03, PNorm = 259.7812, GNorm = 0.3359, lr_0 = 9.9857e-04
Validation auc = 0.719226
Epoch 2499
Loss = 5.3395e-03, PNorm = 259.8449, GNorm = 0.3432, lr_0 = 9.9857e-04
Loss = 2.2036e-02, PNorm = 259.9100, GNorm = 0.2220, lr_0 = 9.9857e-04
Validation auc = 0.711462
Epoch 2500
Loss = 3.4913e-02, PNorm = 259.9551, GNorm = 0.1431, lr_0 = 9.9857e-04
Validation auc = 0.711787
Epoch 2501
Loss = 2.5054e-02, PNorm = 260.0188, GNorm = 0.6217, lr_0 = 9.9857e-04
Validation auc = 0.719383
Epoch 2502
Loss = 3.2279e-02, PNorm = 260.0918, GNorm = 0.1915, lr_0 = 9.9857e-04
Validation auc = 0.711208
Epoch 2503
Loss = 2.0947e-02, PNorm = 260.1493, GNorm = 0.0671, lr_0 = 9.9857e-04
Validation auc = 0.710679
Epoch 2504
Loss = 3.0216e-02, PNorm = 260.2004, GNorm = 0.9290, lr_0 = 9.9856e-04
Validation auc = 0.717751
Epoch 2505
Loss = 7.0975e-03, PNorm = 260.2472, GNorm = 0.0807, lr_0 = 9.9856e-04
Validation auc = 0.713485
Epoch 2506
Loss = 1.4405e-02, PNorm = 260.3094, GNorm = 0.3026, lr_0 = 9.9856e-04
Validation auc = 0.707985
Epoch 2507
Loss = 7.6067e-03, PNorm = 260.3681, GNorm = 0.7632, lr_0 = 9.9856e-04
Validation auc = 0.704343
Epoch 2508
Loss = 4.0788e-03, PNorm = 260.4176, GNorm = 0.2826, lr_0 = 9.9856e-04
Validation auc = 0.704408
Epoch 2509
Loss = 1.2771e-02, PNorm = 260.4532, GNorm = 0.7584, lr_0 = 9.9856e-04
Loss = 2.1317e-02, PNorm = 260.5038, GNorm = 1.2824, lr_0 = 9.9856e-04
Validation auc = 0.712627
Epoch 2510
Loss = 2.3984e-02, PNorm = 260.5733, GNorm = 1.0161, lr_0 = 9.9856e-04
Validation auc = 0.719477
Epoch 2511
Loss = 5.6793e-02, PNorm = 260.6325, GNorm = 0.5785, lr_0 = 9.9856e-04
Validation auc = 0.705645
Epoch 2512
Loss = 1.9037e-02, PNorm = 260.6960, GNorm = 1.7945, lr_0 = 9.9856e-04
Validation auc = 0.700826
Epoch 2513
Loss = 5.3940e-02, PNorm = 260.7550, GNorm = 0.1006, lr_0 = 9.9856e-04
Validation auc = 0.713012
Epoch 2514
Loss = 1.3891e-02, PNorm = 260.8086, GNorm = 0.2459, lr_0 = 9.9856e-04
Validation auc = 0.711017
Epoch 2515
Loss = 1.6853e-02, PNorm = 260.8650, GNorm = 1.2383, lr_0 = 9.9856e-04
Validation auc = 0.723000
Epoch 2516
Loss = 3.1403e-02, PNorm = 260.9320, GNorm = 0.1011, lr_0 = 9.9856e-04
Validation auc = 0.730048
Epoch 2517
Loss = 7.8253e-03, PNorm = 260.9891, GNorm = 0.1523, lr_0 = 9.9856e-04
Validation auc = 0.731118
Epoch 2518
Loss = 2.3496e-02, PNorm = 261.0314, GNorm = 0.6865, lr_0 = 9.9855e-04
Validation auc = 0.727316
Epoch 2519
Loss = 4.3146e-02, PNorm = 261.0869, GNorm = 0.7749, lr_0 = 9.9855e-04
Loss = 3.6194e-02, PNorm = 261.1511, GNorm = 0.4541, lr_0 = 9.9855e-04
Validation auc = 0.729733
Epoch 2520
Loss = 1.0277e-02, PNorm = 261.2164, GNorm = 0.0560, lr_0 = 9.9855e-04
Validation auc = 0.721654
Epoch 2521
Loss = 1.0514e-02, PNorm = 261.2619, GNorm = 0.2942, lr_0 = 9.9855e-04
Validation auc = 0.716561
Epoch 2522
Loss = 2.0455e-02, PNorm = 261.2963, GNorm = 0.1837, lr_0 = 9.9855e-04
Validation auc = 0.720419
Epoch 2523
Loss = 2.3003e-02, PNorm = 261.3293, GNorm = 0.2377, lr_0 = 9.9855e-04
Validation auc = 0.722705
Epoch 2524
Loss = 2.9713e-02, PNorm = 261.3740, GNorm = 1.7224, lr_0 = 9.9855e-04
Validation auc = 0.710830
Epoch 2525
Loss = 1.8143e-02, PNorm = 261.4405, GNorm = 0.0909, lr_0 = 9.9855e-04
Validation auc = 0.691272
Epoch 2526
Loss = 1.9158e-02, PNorm = 261.5196, GNorm = 1.7232, lr_0 = 9.9855e-04
Validation auc = 0.693175
Epoch 2527
Loss = 8.1372e-03, PNorm = 261.5918, GNorm = 0.2379, lr_0 = 9.9855e-04
Validation auc = 0.704048
Epoch 2528
Loss = 2.8554e-03, PNorm = 261.6423, GNorm = 0.0755, lr_0 = 9.9855e-04
Validation auc = 0.709755
Epoch 2529
Loss = 1.0972e-02, PNorm = 261.6734, GNorm = 0.6315, lr_0 = 9.9855e-04
Loss = 1.8163e-02, PNorm = 261.7075, GNorm = 0.1000, lr_0 = 9.9855e-04
Validation auc = 0.715526
Epoch 2530
Loss = 3.3151e-02, PNorm = 261.7541, GNorm = 0.2510, lr_0 = 9.9854e-04
Validation auc = 0.723157
Epoch 2531
Loss = 7.2513e-03, PNorm = 261.8242, GNorm = 1.1007, lr_0 = 9.9854e-04
Validation auc = 0.731534
Epoch 2532
Loss = 4.0408e-02, PNorm = 261.8794, GNorm = 2.1186, lr_0 = 9.9854e-04
Validation auc = 0.720349
Epoch 2533
Loss = 9.2489e-03, PNorm = 261.9355, GNorm = 0.2303, lr_0 = 9.9854e-04
Validation auc = 0.709583
Epoch 2534
Loss = 2.3295e-02, PNorm = 261.9910, GNorm = 0.8429, lr_0 = 9.9854e-04
Validation auc = 0.703544
Epoch 2535
Loss = 3.7100e-02, PNorm = 262.0510, GNorm = 0.4224, lr_0 = 9.9854e-04
Validation auc = 0.700531
Epoch 2536
Loss = 1.6677e-02, PNorm = 262.1044, GNorm = 2.1858, lr_0 = 9.9854e-04
Validation auc = 0.709532
Epoch 2537
Loss = 2.4823e-02, PNorm = 262.1656, GNorm = 0.2979, lr_0 = 9.9854e-04
Validation auc = 0.706263
Epoch 2538
Loss = 3.0512e-02, PNorm = 262.2366, GNorm = 1.7261, lr_0 = 9.9854e-04
Validation auc = 0.700615
Epoch 2539
Loss = 3.5841e-03, PNorm = 262.2986, GNorm = 0.1111, lr_0 = 9.9854e-04
Loss = 3.2121e-02, PNorm = 262.3449, GNorm = 0.2004, lr_0 = 9.9854e-04
Validation auc = 0.702391
Epoch 2540
Loss = 2.6869e-02, PNorm = 262.3942, GNorm = 0.1262, lr_0 = 9.9854e-04
Validation auc = 0.711468
Epoch 2541
Loss = 4.9666e-02, PNorm = 262.4564, GNorm = 0.6948, lr_0 = 9.9854e-04
Validation auc = 0.730908
Epoch 2542
Loss = 1.8143e-02, PNorm = 262.5186, GNorm = 0.0697, lr_0 = 9.9854e-04
Validation auc = 0.733849
Epoch 2543
Loss = 3.5452e-02, PNorm = 262.5672, GNorm = 0.7438, lr_0 = 9.9854e-04
Validation auc = 0.726140
Epoch 2544
Loss = 7.1202e-03, PNorm = 262.6124, GNorm = 0.9789, lr_0 = 9.9853e-04
Validation auc = 0.718530
Epoch 2545
Loss = 2.4940e-02, PNorm = 262.6496, GNorm = 1.2883, lr_0 = 9.9853e-04
Validation auc = 0.706326
Epoch 2546
Loss = 3.4616e-02, PNorm = 262.6893, GNorm = 0.9741, lr_0 = 9.9853e-04
Validation auc = 0.701684
Epoch 2547
Loss = 4.5953e-03, PNorm = 262.7284, GNorm = 0.0872, lr_0 = 9.9853e-04
Validation auc = 0.702087
Epoch 2548
Loss = 6.6170e-02, PNorm = 262.7770, GNorm = 0.8154, lr_0 = 9.9853e-04
Validation auc = 0.709310
Epoch 2549
Loss = 4.3143e-03, PNorm = 262.8530, GNorm = 0.1439, lr_0 = 9.9853e-04
Loss = 2.7827e-02, PNorm = 262.9432, GNorm = 0.4678, lr_0 = 9.9853e-04
Validation auc = 0.703555
Epoch 2550
Loss = 3.1207e-02, PNorm = 263.0173, GNorm = 0.1728, lr_0 = 9.9853e-04
Validation auc = 0.700581
Epoch 2551
Loss = 3.5395e-02, PNorm = 263.0921, GNorm = 3.1999, lr_0 = 9.9853e-04
Validation auc = 0.698695
Epoch 2552
Loss = 3.1961e-02, PNorm = 263.1542, GNorm = 0.2170, lr_0 = 9.9853e-04
Validation auc = 0.696307
Epoch 2553
Loss = 5.3139e-02, PNorm = 263.2192, GNorm = 0.3622, lr_0 = 9.9853e-04
Validation auc = 0.692369
Epoch 2554
Loss = 2.8727e-02, PNorm = 263.2905, GNorm = 0.1202, lr_0 = 9.9853e-04
Validation auc = 0.692050
Epoch 2555
Loss = 3.0001e-02, PNorm = 263.3524, GNorm = 1.0274, lr_0 = 9.9853e-04
Validation auc = 0.688446
Epoch 2556
Loss = 2.5257e-02, PNorm = 263.4269, GNorm = 0.6286, lr_0 = 9.9853e-04
Validation auc = 0.694124
Epoch 2557
Loss = 5.1449e-03, PNorm = 263.4915, GNorm = 0.4298, lr_0 = 9.9852e-04
Validation auc = 0.698234
Epoch 2558
Loss = 1.2403e-02, PNorm = 263.5430, GNorm = 0.6690, lr_0 = 9.9852e-04
Validation auc = 0.698833
Epoch 2559
Loss = 1.0231e-01, PNorm = 263.5995, GNorm = 1.2732, lr_0 = 9.9852e-04
Loss = 2.1428e-02, PNorm = 263.6519, GNorm = 0.0879, lr_0 = 9.9852e-04
Validation auc = 0.701369
Epoch 2560
Loss = 3.4115e-02, PNorm = 263.7094, GNorm = 0.1990, lr_0 = 9.9852e-04
Validation auc = 0.709399
Epoch 2561
Loss = 2.6448e-02, PNorm = 263.7637, GNorm = 0.1831, lr_0 = 9.9852e-04
Validation auc = 0.708436
Epoch 2562
Loss = 2.1153e-02, PNorm = 263.8228, GNorm = 0.2239, lr_0 = 9.9852e-04
Validation auc = 0.704145
Epoch 2563
Loss = 1.3799e-02, PNorm = 263.8719, GNorm = 2.5992, lr_0 = 9.9852e-04
Validation auc = 0.699873
Epoch 2564
Loss = 6.3577e-03, PNorm = 263.9024, GNorm = 0.2438, lr_0 = 9.9852e-04
Validation auc = 0.699247
Epoch 2565
Loss = 2.7464e-02, PNorm = 263.9329, GNorm = 2.5644, lr_0 = 9.9852e-04
Validation auc = 0.702142
Epoch 2566
Loss = 8.6874e-03, PNorm = 263.9765, GNorm = 0.3519, lr_0 = 9.9852e-04
Validation auc = 0.703948
Epoch 2567
Loss = 2.1597e-02, PNorm = 264.0234, GNorm = 1.2406, lr_0 = 9.9852e-04
Validation auc = 0.706427
Epoch 2568
Loss = 2.7062e-01, PNorm = 264.0679, GNorm = 2.8951, lr_0 = 9.9852e-04
Validation auc = 0.709088
Epoch 2569
Loss = 1.8994e-02, PNorm = 264.1282, GNorm = 0.3923, lr_0 = 9.9852e-04
Loss = 2.5375e-02, PNorm = 264.1962, GNorm = 0.9016, lr_0 = 9.9852e-04
Validation auc = 0.708482
Epoch 2570
Loss = 1.2510e-02, PNorm = 264.2512, GNorm = 0.6738, lr_0 = 9.9851e-04
Validation auc = 0.708254
Epoch 2571
Loss = 4.3548e-02, PNorm = 264.3077, GNorm = 2.0665, lr_0 = 9.9851e-04
Validation auc = 0.710943
Epoch 2572
Loss = 4.8055e-02, PNorm = 264.3627, GNorm = 0.3460, lr_0 = 9.9851e-04
Validation auc = 0.712381
Epoch 2573
Loss = 1.1488e-02, PNorm = 264.4087, GNorm = 0.0899, lr_0 = 9.9851e-04
Validation auc = 0.708936
Epoch 2574
Loss = 7.6709e-02, PNorm = 264.4517, GNorm = 1.0193, lr_0 = 9.9851e-04
Validation auc = 0.706295
Epoch 2575
Loss = 2.3697e-02, PNorm = 264.5136, GNorm = 0.1624, lr_0 = 9.9851e-04
Validation auc = 0.696273
Epoch 2576
Loss = 2.4678e-02, PNorm = 264.5711, GNorm = 0.4465, lr_0 = 9.9851e-04
Validation auc = 0.691747
Epoch 2577
Loss = 4.6133e-02, PNorm = 264.6222, GNorm = 0.3292, lr_0 = 9.9851e-04
Validation auc = 0.695286
Epoch 2578
Loss = 3.6419e-02, PNorm = 264.6701, GNorm = 1.8277, lr_0 = 9.9851e-04
Validation auc = 0.705674
Epoch 2579
Loss = 5.2881e-02, PNorm = 264.7242, GNorm = 1.6716, lr_0 = 9.9851e-04
Loss = 6.1456e-02, PNorm = 264.7847, GNorm = 0.1904, lr_0 = 9.9851e-04
Validation auc = 0.674478
Epoch 2580
Loss = 2.0957e-02, PNorm = 264.8529, GNorm = 0.7058, lr_0 = 9.9851e-04
Validation auc = 0.668071
Epoch 2581
Loss = 4.0998e-02, PNorm = 264.8998, GNorm = 0.4638, lr_0 = 9.9851e-04
Validation auc = 0.681148
Epoch 2582
Loss = 9.0655e-03, PNorm = 264.9584, GNorm = 0.0988, lr_0 = 9.9851e-04
Validation auc = 0.682878
Epoch 2583
Loss = 5.4140e-02, PNorm = 265.0099, GNorm = 0.2904, lr_0 = 9.9850e-04
Validation auc = 0.662436
Epoch 2584
Loss = 1.7543e-02, PNorm = 265.0662, GNorm = 0.6982, lr_0 = 9.9850e-04
Validation auc = 0.661176
Epoch 2585
Loss = 7.1203e-03, PNorm = 265.1197, GNorm = 0.1101, lr_0 = 9.9850e-04
Validation auc = 0.665605
Epoch 2586
Loss = 2.5550e-02, PNorm = 265.1616, GNorm = 2.0431, lr_0 = 9.9850e-04
Validation auc = 0.660940
Epoch 2587
Loss = 6.1008e-03, PNorm = 265.2078, GNorm = 0.8100, lr_0 = 9.9850e-04
Validation auc = 0.667247
Epoch 2588
Loss = 1.0934e-01, PNorm = 265.2497, GNorm = 1.6255, lr_0 = 9.9850e-04
Validation auc = 0.673940
Epoch 2589
Loss = 7.9322e-02, PNorm = 265.2869, GNorm = 1.4063, lr_0 = 9.9850e-04
Loss = 3.4362e-02, PNorm = 265.3347, GNorm = 1.2326, lr_0 = 9.9850e-04
Validation auc = 0.667977
Epoch 2590
Loss = 3.7679e-02, PNorm = 265.3885, GNorm = 2.3294, lr_0 = 9.9850e-04
Validation auc = 0.673277
Epoch 2591
Loss = 3.2044e-02, PNorm = 265.4483, GNorm = 1.2356, lr_0 = 9.9850e-04
Validation auc = 0.681942
Epoch 2592
Loss = 2.1535e-02, PNorm = 265.5087, GNorm = 0.4548, lr_0 = 9.9850e-04
Validation auc = 0.690814
Epoch 2593
Loss = 2.2644e-02, PNorm = 265.5567, GNorm = 1.9861, lr_0 = 9.9850e-04
Validation auc = 0.696453
Epoch 2594
Loss = 6.0582e-02, PNorm = 265.5987, GNorm = 0.9058, lr_0 = 9.9850e-04
Validation auc = 0.697290
Epoch 2595
Loss = 1.0539e-02, PNorm = 265.6431, GNorm = 0.2614, lr_0 = 9.9850e-04
Validation auc = 0.699453
Epoch 2596
Loss = 9.8684e-03, PNorm = 265.6840, GNorm = 0.5967, lr_0 = 9.9850e-04
Validation auc = 0.698680
Epoch 2597
Loss = 2.8335e-02, PNorm = 265.7330, GNorm = 0.1170, lr_0 = 9.9849e-04
Validation auc = 0.699707
Epoch 2598
Loss = 1.4188e-03, PNorm = 265.7942, GNorm = 0.0290, lr_0 = 9.9849e-04
Validation auc = 0.694246
Epoch 2599
Loss = 4.9784e-02, PNorm = 265.8465, GNorm = 0.6331, lr_0 = 9.9849e-04
Loss = 1.6418e-02, PNorm = 265.8895, GNorm = 0.1375, lr_0 = 9.9849e-04
Validation auc = 0.691044
Epoch 2600
Loss = 8.6756e-03, PNorm = 265.9268, GNorm = 0.4760, lr_0 = 9.9849e-04
Validation auc = 0.693073
Epoch 2601
Loss = 1.9124e-02, PNorm = 265.9702, GNorm = 0.2323, lr_0 = 9.9849e-04
Validation auc = 0.680073
Epoch 2602
Loss = 5.4884e-02, PNorm = 266.0198, GNorm = 0.5047, lr_0 = 9.9849e-04
Validation auc = 0.683474
Epoch 2603
Loss = 3.2904e-02, PNorm = 266.0714, GNorm = 1.2018, lr_0 = 9.9849e-04
Validation auc = 0.691000
Epoch 2604
Loss = 2.6735e-02, PNorm = 266.1334, GNorm = 2.6829, lr_0 = 9.9849e-04
Validation auc = 0.695829
Epoch 2605
Loss = 1.9837e-02, PNorm = 266.2028, GNorm = 0.0252, lr_0 = 9.9849e-04
Validation auc = 0.696427
Epoch 2606
Loss = 8.7794e-03, PNorm = 266.2748, GNorm = 0.2286, lr_0 = 9.9849e-04
Validation auc = 0.695134
Epoch 2607
Loss = 1.3852e-02, PNorm = 266.3430, GNorm = 1.1453, lr_0 = 9.9849e-04
Validation auc = 0.702025
Epoch 2608
Loss = 1.6532e-02, PNorm = 266.3969, GNorm = 0.1027, lr_0 = 9.9849e-04
Validation auc = 0.703136
Epoch 2609
Loss = 3.8282e-03, PNorm = 266.4416, GNorm = 0.2126, lr_0 = 9.9849e-04
Loss = 2.7254e-02, PNorm = 266.4962, GNorm = 1.3447, lr_0 = 9.9848e-04
Validation auc = 0.696764
Epoch 2610
Loss = 3.3637e-02, PNorm = 266.5472, GNorm = 0.8681, lr_0 = 9.9848e-04
Validation auc = 0.704001
Epoch 2611
Loss = 3.6037e-02, PNorm = 266.6069, GNorm = 0.7659, lr_0 = 9.9848e-04
Validation auc = 0.703742
Epoch 2612
Loss = 3.7299e-02, PNorm = 266.6890, GNorm = 0.2058, lr_0 = 9.9848e-04
Validation auc = 0.698973
Epoch 2613
Loss = 1.9490e-02, PNorm = 266.7641, GNorm = 0.5433, lr_0 = 9.9848e-04
Validation auc = 0.698963
Epoch 2614
Loss = 4.8876e-02, PNorm = 266.8194, GNorm = 1.1036, lr_0 = 9.9848e-04
Validation auc = 0.697409
Epoch 2615
Loss = 1.9449e-02, PNorm = 266.8752, GNorm = 0.7471, lr_0 = 9.9848e-04
Validation auc = 0.688512
Epoch 2616
Loss = 1.0706e-02, PNorm = 266.9322, GNorm = 0.2410, lr_0 = 9.9848e-04
Validation auc = 0.693946
Epoch 2617
Loss = 4.6403e-02, PNorm = 266.9747, GNorm = 1.7624, lr_0 = 9.9848e-04
Validation auc = 0.700866
Epoch 2618
Loss = 7.2902e-03, PNorm = 267.0073, GNorm = 0.0679, lr_0 = 9.9848e-04
Validation auc = 0.712177
Epoch 2619
Loss = 3.9150e-03, PNorm = 267.0581, GNorm = 0.1263, lr_0 = 9.9848e-04
Loss = 2.0631e-02, PNorm = 267.1306, GNorm = 0.7635, lr_0 = 9.9848e-04
Validation auc = 0.713614
Epoch 2620
Loss = 3.0396e-02, PNorm = 267.1860, GNorm = 0.3666, lr_0 = 9.9848e-04
Validation auc = 0.713983
Epoch 2621
Loss = 1.8123e-02, PNorm = 267.2416, GNorm = 0.3189, lr_0 = 9.9848e-04
Validation auc = 0.711926
Epoch 2622
Loss = 2.2568e-02, PNorm = 267.2918, GNorm = 2.0372, lr_0 = 9.9848e-04
Validation auc = 0.707294
Epoch 2623
Loss = 3.9499e-02, PNorm = 267.3382, GNorm = 1.5353, lr_0 = 9.9847e-04
Validation auc = 0.709415
Epoch 2624
Loss = 1.4532e-02, PNorm = 267.3892, GNorm = 0.5389, lr_0 = 9.9847e-04
Validation auc = 0.709068
Epoch 2625
Loss = 1.9378e-02, PNorm = 267.4468, GNorm = 0.2727, lr_0 = 9.9847e-04
Validation auc = 0.708244
Epoch 2626
Loss = 1.2160e-02, PNorm = 267.5032, GNorm = 0.3273, lr_0 = 9.9847e-04
Validation auc = 0.703388
Epoch 2627
Loss = 2.9518e-02, PNorm = 267.5506, GNorm = 0.0451, lr_0 = 9.9847e-04
Validation auc = 0.697658
Epoch 2628
Loss = 1.5078e-02, PNorm = 267.5882, GNorm = 0.8495, lr_0 = 9.9847e-04
Validation auc = 0.695263
Epoch 2629
Loss = 1.1878e-02, PNorm = 267.6329, GNorm = 0.9466, lr_0 = 9.9847e-04
Loss = 3.9509e-02, PNorm = 267.6905, GNorm = 1.3300, lr_0 = 9.9847e-04
Validation auc = 0.706512
Epoch 2630
Loss = 1.7035e-02, PNorm = 267.7420, GNorm = 3.2730, lr_0 = 9.9847e-04
Validation auc = 0.704649
Epoch 2631
Loss = 2.1827e-02, PNorm = 267.8065, GNorm = 0.1467, lr_0 = 9.9847e-04
Validation auc = 0.702426
Epoch 2632
Loss = 3.4068e-02, PNorm = 267.8627, GNorm = 0.0367, lr_0 = 9.9847e-04
Validation auc = 0.710843
Epoch 2633
Loss = 1.6765e-02, PNorm = 267.9139, GNorm = 0.2416, lr_0 = 9.9847e-04
Validation auc = 0.708972
Epoch 2634
Loss = 5.3239e-02, PNorm = 267.9691, GNorm = 0.7921, lr_0 = 9.9847e-04
Validation auc = 0.716983
Epoch 2635
Loss = 2.7127e-02, PNorm = 268.0293, GNorm = 0.4753, lr_0 = 9.9847e-04
Validation auc = 0.718406
Epoch 2636
Loss = 2.5681e-02, PNorm = 268.0879, GNorm = 0.0708, lr_0 = 9.9847e-04
Validation auc = 0.715299
Epoch 2637
Loss = 4.1581e-02, PNorm = 268.1535, GNorm = 2.4799, lr_0 = 9.9846e-04
Validation auc = 0.707699
Epoch 2638
Loss = 3.6032e-02, PNorm = 268.2124, GNorm = 2.2819, lr_0 = 9.9846e-04
Validation auc = 0.702376
Epoch 2639
Loss = 1.5090e-03, PNorm = 268.2609, GNorm = 0.0800, lr_0 = 9.9846e-04
Loss = 1.4638e-02, PNorm = 268.3061, GNorm = 0.0576, lr_0 = 9.9846e-04
Validation auc = 0.707791
Epoch 2640
Loss = 2.3770e-02, PNorm = 268.3658, GNorm = 0.0466, lr_0 = 9.9846e-04
Validation auc = 0.704638
Epoch 2641
Loss = 7.5835e-03, PNorm = 268.4178, GNorm = 0.1112, lr_0 = 9.9846e-04
Validation auc = 0.706856
Epoch 2642
Loss = 9.8409e-03, PNorm = 268.4499, GNorm = 0.7166, lr_0 = 9.9846e-04
Validation auc = 0.713509
Epoch 2643
Loss = 3.4827e-02, PNorm = 268.4775, GNorm = 0.3074, lr_0 = 9.9846e-04
Validation auc = 0.720139
Epoch 2644
Loss = 3.0468e-02, PNorm = 268.5140, GNorm = 0.0279, lr_0 = 9.9846e-04
Validation auc = 0.723319
Epoch 2645
Loss = 1.6600e-02, PNorm = 268.5437, GNorm = 0.1393, lr_0 = 9.9846e-04
Validation auc = 0.718538
Epoch 2646
Loss = 1.1624e-02, PNorm = 268.5871, GNorm = 0.0385, lr_0 = 9.9846e-04
Validation auc = 0.715430
Epoch 2647
Loss = 1.6236e-02, PNorm = 268.6384, GNorm = 0.0555, lr_0 = 9.9846e-04
Validation auc = 0.714732
Epoch 2648
Loss = 1.7793e-02, PNorm = 268.6870, GNorm = 0.1317, lr_0 = 9.9846e-04
Validation auc = 0.715051
Epoch 2649
Loss = 1.5784e-02, PNorm = 268.7308, GNorm = 1.1759, lr_0 = 9.9846e-04
Loss = 1.7840e-02, PNorm = 268.7679, GNorm = 1.7625, lr_0 = 9.9845e-04
Validation auc = 0.717499
Epoch 2650
Loss = 8.2503e-03, PNorm = 268.8154, GNorm = 0.4802, lr_0 = 9.9845e-04
Validation auc = 0.717223
Epoch 2651
Loss = 6.4722e-02, PNorm = 268.8528, GNorm = 1.5003, lr_0 = 9.9845e-04
Validation auc = 0.723792
Epoch 2652
Loss = 2.0740e-02, PNorm = 268.9129, GNorm = 0.4932, lr_0 = 9.9845e-04
Validation auc = 0.720576
Epoch 2653
Loss = 2.2544e-02, PNorm = 268.9739, GNorm = 0.0802, lr_0 = 9.9845e-04
Validation auc = 0.711385
Epoch 2654
Loss = 1.2079e-02, PNorm = 269.0333, GNorm = 0.3249, lr_0 = 9.9845e-04
Validation auc = 0.714302
Epoch 2655
Loss = 3.0396e-02, PNorm = 269.0971, GNorm = 0.1838, lr_0 = 9.9845e-04
Validation auc = 0.711968
Epoch 2656
Loss = 1.3444e-02, PNorm = 269.1729, GNorm = 0.0463, lr_0 = 9.9845e-04
Validation auc = 0.695647
Epoch 2657
Loss = 5.9380e-02, PNorm = 269.2416, GNorm = 1.0349, lr_0 = 9.9845e-04
Validation auc = 0.700185
Epoch 2658
Loss = 4.9380e-03, PNorm = 269.2916, GNorm = 0.6131, lr_0 = 9.9845e-04
Validation auc = 0.711788
Epoch 2659
Loss = 8.5458e-03, PNorm = 269.3349, GNorm = 0.4622, lr_0 = 9.9845e-04
Loss = 5.0756e-02, PNorm = 269.4055, GNorm = 2.3930, lr_0 = 9.9845e-04
Validation auc = 0.717674
Epoch 2660
Loss = 9.0926e-02, PNorm = 269.5077, GNorm = 2.9495, lr_0 = 9.9845e-04
Validation auc = 0.717567
Epoch 2661
Loss = 4.0504e-02, PNorm = 269.6271, GNorm = 1.3963, lr_0 = 9.9845e-04
Validation auc = 0.711771
Epoch 2662
Loss = 2.1483e-02, PNorm = 269.7257, GNorm = 0.9673, lr_0 = 9.9845e-04
Validation auc = 0.712346
Epoch 2663
Loss = 2.7868e-02, PNorm = 269.8038, GNorm = 1.9567, lr_0 = 9.9844e-04
Validation auc = 0.717685
Epoch 2664
Loss = 2.6738e-02, PNorm = 269.8721, GNorm = 1.0019, lr_0 = 9.9844e-04
Validation auc = 0.714890
Epoch 2665
Loss = 3.5825e-02, PNorm = 269.9456, GNorm = 0.1646, lr_0 = 9.9844e-04
Validation auc = 0.713236
Epoch 2666
Loss = 2.1664e-02, PNorm = 270.0108, GNorm = 0.0219, lr_0 = 9.9844e-04
Validation auc = 0.691082
Epoch 2667
Loss = 3.2898e-02, PNorm = 270.0672, GNorm = 2.0432, lr_0 = 9.9844e-04
Validation auc = 0.685122
Epoch 2668
Loss = 1.0052e-01, PNorm = 270.1399, GNorm = 0.0773, lr_0 = 9.9844e-04
Validation auc = 0.690597
Epoch 2669
Loss = 6.0955e-02, PNorm = 270.2477, GNorm = 3.4347, lr_0 = 9.9844e-04
Loss = 2.4750e-02, PNorm = 270.3531, GNorm = 2.2197, lr_0 = 9.9844e-04
Validation auc = 0.710684
Epoch 2670
Loss = 8.6353e-03, PNorm = 270.4265, GNorm = 0.3113, lr_0 = 9.9844e-04
Validation auc = 0.712163
Epoch 2671
Loss = 2.0030e-02, PNorm = 270.4826, GNorm = 0.3766, lr_0 = 9.9844e-04
Validation auc = 0.723305
Epoch 2672
Loss = 3.4577e-02, PNorm = 270.5353, GNorm = 0.9203, lr_0 = 9.9844e-04
Validation auc = 0.734420
Epoch 2673
Loss = 3.9303e-02, PNorm = 270.6071, GNorm = 0.7959, lr_0 = 9.9844e-04
Validation auc = 0.727778
Epoch 2674
Loss = 7.2793e-02, PNorm = 270.6892, GNorm = 2.6796, lr_0 = 9.9844e-04
Validation auc = 0.721632
Epoch 2675
Loss = 5.9919e-02, PNorm = 270.7832, GNorm = 0.7313, lr_0 = 9.9844e-04
Validation auc = 0.730068
Epoch 2676
Loss = 4.5605e-02, PNorm = 270.8633, GNorm = 0.6212, lr_0 = 9.9843e-04
Validation auc = 0.732773
Epoch 2677
Loss = 2.0897e-02, PNorm = 270.9268, GNorm = 0.8793, lr_0 = 9.9843e-04
Validation auc = 0.730484
Epoch 2678
Loss = 2.3147e-02, PNorm = 270.9713, GNorm = 1.5519, lr_0 = 9.9843e-04
Validation auc = 0.725009
Epoch 2679
Loss = 2.8636e-03, PNorm = 271.0055, GNorm = 0.0901, lr_0 = 9.9843e-04
Loss = 3.2821e-02, PNorm = 271.0498, GNorm = 0.1367, lr_0 = 9.9843e-04
Validation auc = 0.721721
Epoch 2680
Loss = 2.7183e-02, PNorm = 271.1042, GNorm = 0.2453, lr_0 = 9.9843e-04
Validation auc = 0.716328
Epoch 2681
Loss = 4.3180e-02, PNorm = 271.1606, GNorm = 0.7726, lr_0 = 9.9843e-04
Validation auc = 0.714342
Epoch 2682
Loss = 3.0047e-02, PNorm = 271.2136, GNorm = 0.4971, lr_0 = 9.9843e-04
Validation auc = 0.724547
Epoch 2683
Loss = 2.4103e-02, PNorm = 271.2600, GNorm = 0.1475, lr_0 = 9.9843e-04
Validation auc = 0.728574
Epoch 2684
Loss = 3.2416e-02, PNorm = 271.3089, GNorm = 0.0928, lr_0 = 9.9843e-04
Validation auc = 0.733186
Epoch 2685
Loss = 3.2532e-02, PNorm = 271.3535, GNorm = 3.4705, lr_0 = 9.9843e-04
Validation auc = 0.726134
Epoch 2686
Loss = 4.9000e-03, PNorm = 271.3987, GNorm = 0.0338, lr_0 = 9.9843e-04
Validation auc = 0.722170
Epoch 2687
Loss = 3.8456e-02, PNorm = 271.4293, GNorm = 0.0990, lr_0 = 9.9843e-04
Validation auc = 0.718578
Epoch 2688
Loss = 1.0034e-02, PNorm = 271.4618, GNorm = 0.3209, lr_0 = 9.9843e-04
Validation auc = 0.729571
Epoch 2689
Loss = 2.1002e-03, PNorm = 271.4966, GNorm = 0.1524, lr_0 = 9.9843e-04
Loss = 1.0884e-02, PNorm = 271.5306, GNorm = 0.7631, lr_0 = 9.9842e-04
Validation auc = 0.734154
Epoch 2690
Loss = 1.0665e-02, PNorm = 271.5561, GNorm = 0.0469, lr_0 = 9.9842e-04
Validation auc = 0.735116
Epoch 2691
Loss = 1.7640e-02, PNorm = 271.5830, GNorm = 0.9634, lr_0 = 9.9842e-04
Validation auc = 0.734574
Epoch 2692
Loss = 7.4686e-03, PNorm = 271.6185, GNorm = 0.0483, lr_0 = 9.9842e-04
Validation auc = 0.735872
Epoch 2693
Loss = 2.6631e-03, PNorm = 271.6438, GNorm = 0.0608, lr_0 = 9.9842e-04
Validation auc = 0.735624
Epoch 2694
Loss = 9.3417e-03, PNorm = 271.6595, GNorm = 1.7730, lr_0 = 9.9842e-04
Validation auc = 0.737514
Epoch 2695
Loss = 2.2739e-02, PNorm = 271.6819, GNorm = 1.6306, lr_0 = 9.9842e-04
Validation auc = 0.736981
Epoch 2696
Loss = 3.0970e-02, PNorm = 271.7156, GNorm = 0.3383, lr_0 = 9.9842e-04
Validation auc = 0.732186
Epoch 2697
Loss = 1.6089e-03, PNorm = 271.7586, GNorm = 0.1854, lr_0 = 9.9842e-04
Validation auc = 0.727765
Epoch 2698
Loss = 1.0147e-03, PNorm = 271.7928, GNorm = 0.0572, lr_0 = 9.9842e-04
Validation auc = 0.728942
Epoch 2699
Loss = 4.6264e-03, PNorm = 271.8173, GNorm = 0.2969, lr_0 = 9.9842e-04
Loss = 4.2657e-02, PNorm = 271.8457, GNorm = 0.4026, lr_0 = 9.9842e-04
Validation auc = 0.729453
Epoch 2700
Loss = 1.8088e-02, PNorm = 271.8955, GNorm = 1.3928, lr_0 = 9.9842e-04
Validation auc = 0.731334
Epoch 2701
Loss = 1.2611e-02, PNorm = 271.9427, GNorm = 0.0423, lr_0 = 9.9842e-04
Validation auc = 0.734049
Epoch 2702
Loss = 1.5743e-02, PNorm = 271.9812, GNorm = 0.0151, lr_0 = 9.9841e-04
Validation auc = 0.737887
Epoch 2703
Loss = 2.7892e-02, PNorm = 272.0153, GNorm = 0.0862, lr_0 = 9.9841e-04
Validation auc = 0.732214
Epoch 2704
Loss = 3.2334e-02, PNorm = 272.0577, GNorm = 1.7956, lr_0 = 9.9841e-04
Validation auc = 0.725840
Epoch 2705
Loss = 3.3963e-02, PNorm = 272.0984, GNorm = 0.0631, lr_0 = 9.9841e-04
Validation auc = 0.722019
Epoch 2706
Loss = 5.7160e-02, PNorm = 272.1336, GNorm = 2.3383, lr_0 = 9.9841e-04
Validation auc = 0.723812
Epoch 2707
Loss = 4.0711e-02, PNorm = 272.1843, GNorm = 0.4123, lr_0 = 9.9841e-04
Validation auc = 0.720706
Epoch 2708
Loss = 2.0684e-02, PNorm = 272.2567, GNorm = 1.7059, lr_0 = 9.9841e-04
Validation auc = 0.718169
Epoch 2709
Loss = 8.0010e-04, PNorm = 272.3105, GNorm = 0.0263, lr_0 = 9.9841e-04
Loss = 1.4540e-02, PNorm = 272.3475, GNorm = 0.0686, lr_0 = 9.9841e-04
Validation auc = 0.720738
Epoch 2710
Loss = 1.0933e-02, PNorm = 272.3845, GNorm = 0.2627, lr_0 = 9.9841e-04
Validation auc = 0.724948
Epoch 2711
Loss = 4.5750e-02, PNorm = 272.4238, GNorm = 1.5466, lr_0 = 9.9841e-04
Validation auc = 0.722364
Epoch 2712
Loss = 6.0022e-02, PNorm = 272.4838, GNorm = 1.0631, lr_0 = 9.9841e-04
Validation auc = 0.715965
Epoch 2713
Loss = 4.8836e-02, PNorm = 272.5683, GNorm = 1.5899, lr_0 = 9.9841e-04
Validation auc = 0.722035
Epoch 2714
Loss = 8.6137e-03, PNorm = 272.6296, GNorm = 0.3442, lr_0 = 9.9841e-04
Validation auc = 0.730327
Epoch 2715
Loss = 3.1671e-02, PNorm = 272.6761, GNorm = 1.1668, lr_0 = 9.9841e-04
Validation auc = 0.737856
Epoch 2716
Loss = 2.1498e-02, PNorm = 272.7183, GNorm = 0.3804, lr_0 = 9.9840e-04
Validation auc = 0.742672
Epoch 2717
Loss = 3.3900e-02, PNorm = 272.7589, GNorm = 1.1906, lr_0 = 9.9840e-04
Validation auc = 0.744079
Epoch 2718
Loss = 1.1336e-02, PNorm = 272.8188, GNorm = 0.3474, lr_0 = 9.9840e-04
Validation auc = 0.744165
Epoch 2719
Loss = 5.6747e-03, PNorm = 272.8722, GNorm = 0.2001, lr_0 = 9.9840e-04
Loss = 1.1158e-02, PNorm = 272.9190, GNorm = 0.0648, lr_0 = 9.9840e-04
Validation auc = 0.734153
Epoch 2720
Loss = 7.5463e-03, PNorm = 272.9644, GNorm = 0.2416, lr_0 = 9.9840e-04
Validation auc = 0.735147
Epoch 2721
Loss = 1.9117e-02, PNorm = 273.0166, GNorm = 1.5714, lr_0 = 9.9840e-04
Validation auc = 0.732934
Epoch 2722
Loss = 2.5347e-02, PNorm = 273.0964, GNorm = 2.2674, lr_0 = 9.9840e-04
Validation auc = 0.713805
Epoch 2723
Loss = 3.0604e-02, PNorm = 273.2007, GNorm = 0.5121, lr_0 = 9.9840e-04
Validation auc = 0.708750
Epoch 2724
Loss = 8.7941e-03, PNorm = 273.2867, GNorm = 0.0191, lr_0 = 9.9840e-04
Validation auc = 0.706317
Epoch 2725
Loss = 4.4343e-02, PNorm = 273.3482, GNorm = 1.8732, lr_0 = 9.9840e-04
Validation auc = 0.698528
Epoch 2726
Loss = 4.1606e-02, PNorm = 273.4092, GNorm = 0.8660, lr_0 = 9.9840e-04
Validation auc = 0.699986
Epoch 2727
Loss = 5.2704e-02, PNorm = 273.4685, GNorm = 2.8884, lr_0 = 9.9840e-04
Validation auc = 0.703842
Epoch 2728
Loss = 3.5178e-02, PNorm = 273.5398, GNorm = 1.7131, lr_0 = 9.9840e-04
Validation auc = 0.710128
Epoch 2729
Loss = 6.1952e-02, PNorm = 273.6128, GNorm = 1.8169, lr_0 = 9.9839e-04
Loss = 1.0264e-02, PNorm = 273.6763, GNorm = 0.3880, lr_0 = 9.9839e-04
Validation auc = 0.707755
Epoch 2730
Loss = 2.5692e-02, PNorm = 273.7368, GNorm = 0.1487, lr_0 = 9.9839e-04
Validation auc = 0.711901
Epoch 2731
Loss = 3.3941e-02, PNorm = 273.8023, GNorm = 0.2076, lr_0 = 9.9839e-04
Validation auc = 0.720295
Epoch 2732
Loss = 7.0538e-03, PNorm = 273.8625, GNorm = 0.1645, lr_0 = 9.9839e-04
Validation auc = 0.725419
Epoch 2733
Loss = 3.2556e-02, PNorm = 273.9105, GNorm = 1.5271, lr_0 = 9.9839e-04
Validation auc = 0.725734
Epoch 2734
Loss = 2.9815e-02, PNorm = 273.9643, GNorm = 0.1631, lr_0 = 9.9839e-04
Validation auc = 0.723250
Epoch 2735
Loss = 1.9132e-02, PNorm = 274.0209, GNorm = 1.2100, lr_0 = 9.9839e-04
Validation auc = 0.722414
Epoch 2736
Loss = 3.7146e-02, PNorm = 274.0908, GNorm = 1.1683, lr_0 = 9.9839e-04
Validation auc = 0.731881
Epoch 2737
Loss = 9.3735e-03, PNorm = 274.1601, GNorm = 0.2460, lr_0 = 9.9839e-04
Validation auc = 0.732618
Epoch 2738
Loss = 5.7709e-03, PNorm = 274.2089, GNorm = 0.0088, lr_0 = 9.9839e-04
Validation auc = 0.720869
Epoch 2739
Loss = 5.9868e-03, PNorm = 274.2592, GNorm = 0.4107, lr_0 = 9.9839e-04
Loss = 4.3543e-02, PNorm = 274.3167, GNorm = 0.0520, lr_0 = 9.9839e-04
Validation auc = 0.709504
Epoch 2740
Loss = 2.9377e-02, PNorm = 274.3914, GNorm = 0.0952, lr_0 = 9.9839e-04
Validation auc = 0.714971
Epoch 2741
Loss = 2.2207e-02, PNorm = 274.4486, GNorm = 2.8737, lr_0 = 9.9839e-04
Validation auc = 0.711532
Epoch 2742
Loss = 1.3713e-02, PNorm = 274.5079, GNorm = 0.2285, lr_0 = 9.9838e-04
Validation auc = 0.721211
Epoch 2743
Loss = 3.4288e-02, PNorm = 274.5571, GNorm = 0.5957, lr_0 = 9.9838e-04
Validation auc = 0.723505
Epoch 2744
Loss = 2.4179e-02, PNorm = 274.6012, GNorm = 0.2240, lr_0 = 9.9838e-04
Validation auc = 0.716623
Epoch 2745
Loss = 2.0280e-02, PNorm = 274.6538, GNorm = 0.1525, lr_0 = 9.9838e-04
Validation auc = 0.718348
Epoch 2746
Loss = 7.3895e-03, PNorm = 274.7061, GNorm = 0.3005, lr_0 = 9.9838e-04
Validation auc = 0.720710
Epoch 2747
Loss = 7.5401e-03, PNorm = 274.7428, GNorm = 0.8398, lr_0 = 9.9838e-04
Validation auc = 0.723017
Epoch 2748
Loss = 1.2699e-02, PNorm = 274.7700, GNorm = 0.6689, lr_0 = 9.9838e-04
Validation auc = 0.717901
Epoch 2749
Loss = 3.0336e-02, PNorm = 274.7966, GNorm = 1.3163, lr_0 = 9.9838e-04
Loss = 9.7489e-03, PNorm = 274.8391, GNorm = 0.9924, lr_0 = 9.9838e-04
Validation auc = 0.718323
Epoch 2750
Loss = 2.1883e-02, PNorm = 274.8883, GNorm = 2.5161, lr_0 = 9.9838e-04
Validation auc = 0.715352
Epoch 2751
Loss = 7.2964e-03, PNorm = 274.9350, GNorm = 0.2023, lr_0 = 9.9838e-04
Validation auc = 0.714267
Epoch 2752
Loss = 1.3057e-02, PNorm = 274.9776, GNorm = 0.0695, lr_0 = 9.9838e-04
Validation auc = 0.716866
Epoch 2753
Loss = 3.7231e-02, PNorm = 275.0114, GNorm = 0.0872, lr_0 = 9.9838e-04
Validation auc = 0.708397
Epoch 2754
Loss = 1.7296e-02, PNorm = 275.0449, GNorm = 0.4673, lr_0 = 9.9838e-04
Validation auc = 0.700189
Epoch 2755
Loss = 1.3119e-02, PNorm = 275.0745, GNorm = 1.2365, lr_0 = 9.9838e-04
Validation auc = 0.702490
Epoch 2756
Loss = 2.9917e-02, PNorm = 275.1082, GNorm = 0.3098, lr_0 = 9.9837e-04
Validation auc = 0.697921
Epoch 2757
Loss = 2.5677e-02, PNorm = 275.1545, GNorm = 2.8868, lr_0 = 9.9837e-04
Validation auc = 0.702988
Epoch 2758
Loss = 5.5568e-03, PNorm = 275.2100, GNorm = 0.2226, lr_0 = 9.9837e-04
Validation auc = 0.717850
Epoch 2759
Loss = 7.5804e-02, PNorm = 275.2797, GNorm = 1.8146, lr_0 = 9.9837e-04
Loss = 2.0984e-02, PNorm = 275.3552, GNorm = 0.8771, lr_0 = 9.9837e-04
Validation auc = 0.717812
Epoch 2760
Loss = 2.0222e-02, PNorm = 275.4212, GNorm = 0.2793, lr_0 = 9.9837e-04
Validation auc = 0.714499
Epoch 2761
Loss = 3.8639e-02, PNorm = 275.4739, GNorm = 0.0343, lr_0 = 9.9837e-04
Validation auc = 0.714695
Epoch 2762
Loss = 3.2639e-02, PNorm = 275.5236, GNorm = 0.4261, lr_0 = 9.9837e-04
Validation auc = 0.702660
Epoch 2763
Loss = 2.1221e-02, PNorm = 275.5851, GNorm = 2.5127, lr_0 = 9.9837e-04
Validation auc = 0.705200
Epoch 2764
Loss = 3.1992e-02, PNorm = 275.6574, GNorm = 0.9052, lr_0 = 9.9837e-04
Validation auc = 0.717079
Epoch 2765
Loss = 4.2487e-02, PNorm = 275.7229, GNorm = 1.4204, lr_0 = 9.9837e-04
Validation auc = 0.712587
Epoch 2766
Loss = 2.1953e-02, PNorm = 275.7947, GNorm = 0.6077, lr_0 = 9.9837e-04
Validation auc = 0.711255
Epoch 2767
Loss = 4.5255e-02, PNorm = 275.8522, GNorm = 1.7210, lr_0 = 9.9837e-04
Validation auc = 0.698209
Epoch 2768
Loss = 9.3144e-03, PNorm = 275.9068, GNorm = 0.3129, lr_0 = 9.9837e-04
Validation auc = 0.700298
Epoch 2769
Loss = 1.9605e-02, PNorm = 275.9624, GNorm = 0.4880, lr_0 = 9.9836e-04
Loss = 3.0276e-02, PNorm = 276.0252, GNorm = 0.7997, lr_0 = 9.9836e-04
Validation auc = 0.704750
Epoch 2770
Loss = 2.8139e-02, PNorm = 276.0869, GNorm = 0.0161, lr_0 = 9.9836e-04
Validation auc = 0.694297
Epoch 2771
Loss = 1.1205e-02, PNorm = 276.1493, GNorm = 0.2562, lr_0 = 9.9836e-04
Validation auc = 0.685145
Epoch 2772
Loss = 3.3160e-02, PNorm = 276.2018, GNorm = 0.0743, lr_0 = 9.9836e-04
Validation auc = 0.690792
Epoch 2773
Loss = 2.0236e-02, PNorm = 276.2610, GNorm = 0.8480, lr_0 = 9.9836e-04
Validation auc = 0.695570
Epoch 2774
Loss = 5.7433e-03, PNorm = 276.3231, GNorm = 0.2799, lr_0 = 9.9836e-04
Validation auc = 0.695722
Epoch 2775
Loss = 2.6279e-02, PNorm = 276.3717, GNorm = 2.1393, lr_0 = 9.9836e-04
Validation auc = 0.688501
Epoch 2776
Loss = 4.1810e-02, PNorm = 276.4251, GNorm = 0.6511, lr_0 = 9.9836e-04
Validation auc = 0.690706
Epoch 2777
Loss = 4.6295e-02, PNorm = 276.4948, GNorm = 2.5837, lr_0 = 9.9836e-04
Validation auc = 0.685006
Epoch 2778
Loss = 3.1546e-02, PNorm = 276.5659, GNorm = 0.7769, lr_0 = 9.9836e-04
Validation auc = 0.680241
Epoch 2779
Loss = 4.0400e-03, PNorm = 276.6293, GNorm = 0.1937, lr_0 = 9.9836e-04
Loss = 3.4731e-02, PNorm = 276.6953, GNorm = 0.3793, lr_0 = 9.9836e-04
Validation auc = 0.672512
Epoch 2780
Loss = 1.2309e-02, PNorm = 276.7617, GNorm = 0.0613, lr_0 = 9.9836e-04
Validation auc = 0.664425
Epoch 2781
Loss = 4.6202e-02, PNorm = 276.8165, GNorm = 0.1051, lr_0 = 9.9836e-04
Validation auc = 0.669655
Epoch 2782
Loss = 5.9458e-03, PNorm = 276.8733, GNorm = 0.2197, lr_0 = 9.9835e-04
Validation auc = 0.671726
Epoch 2783
Loss = 3.8432e-02, PNorm = 276.9182, GNorm = 3.8111, lr_0 = 9.9835e-04
Validation auc = 0.679786
Epoch 2784
Loss = 1.5480e-02, PNorm = 276.9681, GNorm = 0.6062, lr_0 = 9.9835e-04
Validation auc = 0.677942
Epoch 2785
Loss = 4.3379e-02, PNorm = 277.0100, GNorm = 0.5828, lr_0 = 9.9835e-04
Validation auc = 0.690077
Epoch 2786
Loss = 1.4801e-02, PNorm = 277.0606, GNorm = 1.2583, lr_0 = 9.9835e-04
Validation auc = 0.692947
Epoch 2787
Loss = 2.9039e-02, PNorm = 277.1185, GNorm = 0.3363, lr_0 = 9.9835e-04
Validation auc = 0.688283
Epoch 2788
Loss = 1.4694e-02, PNorm = 277.1636, GNorm = 0.5266, lr_0 = 9.9835e-04
Validation auc = 0.686481
Epoch 2789
Loss = 3.4517e-03, PNorm = 277.2051, GNorm = 0.0973, lr_0 = 9.9835e-04
Loss = 4.7008e-02, PNorm = 277.2604, GNorm = 1.2804, lr_0 = 9.9835e-04
Validation auc = 0.683679
Epoch 2790
Loss = 1.8955e-02, PNorm = 277.3228, GNorm = 0.8106, lr_0 = 9.9835e-04
Validation auc = 0.683109
Epoch 2791
Loss = 3.0251e-02, PNorm = 277.3724, GNorm = 1.6781, lr_0 = 9.9835e-04
Validation auc = 0.679857
Epoch 2792
Loss = 7.6656e-02, PNorm = 277.4315, GNorm = 2.4464, lr_0 = 9.9835e-04
Validation auc = 0.676889
Epoch 2793
Loss = 3.8106e-02, PNorm = 277.5085, GNorm = 0.8936, lr_0 = 9.9835e-04
Validation auc = 0.691306
Epoch 2794
Loss = 1.7563e-02, PNorm = 277.5719, GNorm = 0.3102, lr_0 = 9.9835e-04
Validation auc = 0.696218
Epoch 2795
Loss = 5.6656e-03, PNorm = 277.6356, GNorm = 0.2681, lr_0 = 9.9834e-04
Validation auc = 0.692319
Epoch 2796
Loss = 2.3869e-02, PNorm = 277.6898, GNorm = 1.6938, lr_0 = 9.9834e-04
Validation auc = 0.695660
Epoch 2797
Loss = 1.3360e-02, PNorm = 277.7338, GNorm = 0.4740, lr_0 = 9.9834e-04
Validation auc = 0.696890
Epoch 2798
Loss = 1.5601e-01, PNorm = 277.7708, GNorm = 0.2860, lr_0 = 9.9834e-04
Validation auc = 0.694897
Epoch 2799
Loss = 9.5272e-04, PNorm = 277.8099, GNorm = 0.0375, lr_0 = 9.9834e-04
Loss = 7.4343e-03, PNorm = 277.8515, GNorm = 0.0146, lr_0 = 9.9834e-04
Validation auc = 0.698160
Epoch 2800
Loss = 2.9378e-02, PNorm = 277.9006, GNorm = 0.0797, lr_0 = 9.9834e-04
Validation auc = 0.698903
Epoch 2801
Loss = 6.0640e-02, PNorm = 277.9516, GNorm = 0.0283, lr_0 = 9.9834e-04
Validation auc = 0.704143
Epoch 2802
Loss = 4.8139e-02, PNorm = 278.0019, GNorm = 1.2483, lr_0 = 9.9834e-04
Validation auc = 0.701431
Epoch 2803
Loss = 2.3610e-02, PNorm = 278.0572, GNorm = 1.6103, lr_0 = 9.9834e-04
Validation auc = 0.717101
Epoch 2804
Loss = 1.7536e-02, PNorm = 278.1049, GNorm = 0.9558, lr_0 = 9.9834e-04
Validation auc = 0.718911
Epoch 2805
Loss = 6.4946e-02, PNorm = 278.1661, GNorm = 0.2590, lr_0 = 9.9834e-04
Validation auc = 0.730479
Epoch 2806
Loss = 2.1353e-02, PNorm = 278.2388, GNorm = 0.0390, lr_0 = 9.9834e-04
Validation auc = 0.743496
Epoch 2807
Loss = 2.5220e-02, PNorm = 278.2928, GNorm = 0.1470, lr_0 = 9.9834e-04
Validation auc = 0.749598
Epoch 2808
Loss = 5.6159e-03, PNorm = 278.3502, GNorm = 0.4694, lr_0 = 9.9834e-04
Validation auc = 0.753074
Epoch 2809
Loss = 1.1566e-01, PNorm = 278.4058, GNorm = 3.8760, lr_0 = 9.9833e-04
Loss = 2.7541e-02, PNorm = 278.4621, GNorm = 0.0371, lr_0 = 9.9833e-04
Validation auc = 0.746937
Epoch 2810
Loss = 2.2432e-02, PNorm = 278.5145, GNorm = 0.0551, lr_0 = 9.9833e-04
Validation auc = 0.739438
Epoch 2811
Loss = 1.8207e-02, PNorm = 278.5577, GNorm = 1.6764, lr_0 = 9.9833e-04
Validation auc = 0.737983
Epoch 2812
Loss = 1.2365e-02, PNorm = 278.5941, GNorm = 1.2237, lr_0 = 9.9833e-04
Validation auc = 0.731605
Epoch 2813
Loss = 2.5653e-02, PNorm = 278.6335, GNorm = 0.3149, lr_0 = 9.9833e-04
Validation auc = 0.719689
Epoch 2814
Loss = 9.5055e-03, PNorm = 278.6830, GNorm = 0.1861, lr_0 = 9.9833e-04
Validation auc = 0.716277
Epoch 2815
Loss = 1.0302e-02, PNorm = 278.7290, GNorm = 1.7987, lr_0 = 9.9833e-04
Validation auc = 0.717101
Epoch 2816
Loss = 1.1638e-02, PNorm = 278.7761, GNorm = 0.1382, lr_0 = 9.9833e-04
Validation auc = 0.721161
Epoch 2817
Loss = 4.0844e-02, PNorm = 278.8292, GNorm = 2.3937, lr_0 = 9.9833e-04
Validation auc = 0.722926
Epoch 2818
Loss = 4.0942e-03, PNorm = 278.8955, GNorm = 0.2845, lr_0 = 9.9833e-04
Validation auc = 0.717431
Epoch 2819
Loss = 1.5028e-02, PNorm = 278.9658, GNorm = 0.3618, lr_0 = 9.9833e-04
Loss = 2.6762e-02, PNorm = 279.0262, GNorm = 0.7833, lr_0 = 9.9833e-04
Validation auc = 0.720405
Epoch 2820
Loss = 5.4169e-02, PNorm = 279.0796, GNorm = 1.4184, lr_0 = 9.9833e-04
Validation auc = 0.720844
Epoch 2821
Loss = 5.9487e-02, PNorm = 279.1393, GNorm = 1.3577, lr_0 = 9.9832e-04
Validation auc = 0.723913
Epoch 2822
Loss = 1.6301e-02, PNorm = 279.1899, GNorm = 0.3112, lr_0 = 9.9832e-04
Validation auc = 0.725002
Epoch 2823
Loss = 1.5945e-02, PNorm = 279.2264, GNorm = 0.2230, lr_0 = 9.9832e-04
Validation auc = 0.726132
Epoch 2824
Loss = 4.6121e-02, PNorm = 279.2579, GNorm = 0.1364, lr_0 = 9.9832e-04
Validation auc = 0.722115
Epoch 2825
Loss = 1.9115e-02, PNorm = 279.3038, GNorm = 1.2071, lr_0 = 9.9832e-04
Validation auc = 0.717837
Epoch 2826
Loss = 1.5922e-02, PNorm = 279.3633, GNorm = 0.6384, lr_0 = 9.9832e-04
Validation auc = 0.724287
Epoch 2827
Loss = 6.8892e-03, PNorm = 279.4253, GNorm = 0.5899, lr_0 = 9.9832e-04
Validation auc = 0.723801
Epoch 2828
Loss = 6.4495e-02, PNorm = 279.4787, GNorm = 0.5720, lr_0 = 9.9832e-04
Validation auc = 0.723976
Epoch 2829
Loss = 3.1017e-03, PNorm = 279.5380, GNorm = 0.1292, lr_0 = 9.9832e-04
Loss = 2.8306e-02, PNorm = 279.5970, GNorm = 1.5506, lr_0 = 9.9832e-04
Validation auc = 0.719888
Epoch 2830
Loss = 2.4253e-02, PNorm = 279.6655, GNorm = 0.0664, lr_0 = 9.9832e-04
Validation auc = 0.712127
Epoch 2831
Loss = 1.6049e-02, PNorm = 279.7215, GNorm = 0.6467, lr_0 = 9.9832e-04
Validation auc = 0.713630
Epoch 2832
Loss = 3.1874e-02, PNorm = 279.7640, GNorm = 1.4201, lr_0 = 9.9832e-04
Validation auc = 0.719450
Epoch 2833
Loss = 6.0922e-02, PNorm = 279.8091, GNorm = 2.9274, lr_0 = 9.9832e-04
Validation auc = 0.726321
Epoch 2834
Loss = 3.5159e-02, PNorm = 279.8783, GNorm = 0.8542, lr_0 = 9.9832e-04
Validation auc = 0.729136
Epoch 2835
Loss = 8.1232e-02, PNorm = 279.9577, GNorm = 1.4967, lr_0 = 9.9831e-04
Validation auc = 0.726845
Epoch 2836
Loss = 1.4432e-02, PNorm = 280.0325, GNorm = 0.9315, lr_0 = 9.9831e-04
Validation auc = 0.728644
Epoch 2837
Loss = 6.1625e-03, PNorm = 280.0875, GNorm = 0.2013, lr_0 = 9.9831e-04
Validation auc = 0.733579
Epoch 2838
Loss = 4.7710e-02, PNorm = 280.1411, GNorm = 1.2000, lr_0 = 9.9831e-04
Validation auc = 0.731779
Epoch 2839
Loss = 1.6269e-03, PNorm = 280.1938, GNorm = 0.0688, lr_0 = 9.9831e-04
Loss = 3.2293e-02, PNorm = 280.2459, GNorm = 0.5640, lr_0 = 9.9831e-04
Validation auc = 0.730401
Epoch 2840
Loss = 3.3801e-02, PNorm = 280.2884, GNorm = 1.5315, lr_0 = 9.9831e-04
Validation auc = 0.725014
Epoch 2841
Loss = 2.2302e-02, PNorm = 280.3395, GNorm = 1.2377, lr_0 = 9.9831e-04
Validation auc = 0.713203
Epoch 2842
Loss = 1.2163e-02, PNorm = 280.3901, GNorm = 0.1125, lr_0 = 9.9831e-04
Validation auc = 0.706698
Epoch 2843
Loss = 4.8048e-02, PNorm = 280.4373, GNorm = 2.0906, lr_0 = 9.9831e-04
Validation auc = 0.709924
Epoch 2844
Loss = 2.6249e-02, PNorm = 280.4850, GNorm = 1.3549, lr_0 = 9.9831e-04
Validation auc = 0.709688
Epoch 2845
Loss = 3.5873e-02, PNorm = 280.5222, GNorm = 0.8382, lr_0 = 9.9831e-04
Validation auc = 0.709119
Epoch 2846
Loss = 3.1918e-02, PNorm = 280.5609, GNorm = 1.1439, lr_0 = 9.9831e-04
Validation auc = 0.709323
Epoch 2847
Loss = 1.3344e-02, PNorm = 280.6035, GNorm = 0.9293, lr_0 = 9.9831e-04
Validation auc = 0.709942
Epoch 2848
Loss = 1.4126e-02, PNorm = 280.6541, GNorm = 0.9180, lr_0 = 9.9830e-04
Validation auc = 0.717287
Epoch 2849
Loss = 6.0685e-03, PNorm = 280.6942, GNorm = 0.4843, lr_0 = 9.9830e-04
Loss = 3.1059e-02, PNorm = 280.7293, GNorm = 1.2252, lr_0 = 9.9830e-04
Validation auc = 0.718169
Epoch 2850
Loss = 3.6542e-02, PNorm = 280.7752, GNorm = 0.3037, lr_0 = 9.9830e-04
Validation auc = 0.718577
Epoch 2851
Loss = 1.1970e-02, PNorm = 280.8372, GNorm = 1.1944, lr_0 = 9.9830e-04
Validation auc = 0.718545
Epoch 2852
Loss = 2.1585e-02, PNorm = 280.8837, GNorm = 2.2706, lr_0 = 9.9830e-04
Validation auc = 0.714800
Epoch 2853
Loss = 2.7526e-02, PNorm = 280.9322, GNorm = 1.3156, lr_0 = 9.9830e-04
Validation auc = 0.716502
Epoch 2854
Loss = 5.8449e-03, PNorm = 281.0009, GNorm = 0.1457, lr_0 = 9.9830e-04
Validation auc = 0.716944
Epoch 2855
Loss = 6.8559e-02, PNorm = 281.0483, GNorm = 2.4113, lr_0 = 9.9830e-04
Validation auc = 0.705872
Epoch 2856
Loss = 8.5124e-03, PNorm = 281.0973, GNorm = 0.0862, lr_0 = 9.9830e-04
Validation auc = 0.703952
Epoch 2857
Loss = 8.9565e-03, PNorm = 281.1333, GNorm = 0.2106, lr_0 = 9.9830e-04
Validation auc = 0.708641
Epoch 2858
Loss = 4.9325e-02, PNorm = 281.1646, GNorm = 0.9741, lr_0 = 9.9830e-04
Validation auc = 0.709320
Epoch 2859
Loss = 8.0028e-03, PNorm = 281.1989, GNorm = 0.2475, lr_0 = 9.9830e-04
Loss = 2.8900e-02, PNorm = 281.2364, GNorm = 1.3155, lr_0 = 9.9830e-04
Validation auc = 0.714723
Epoch 2860
Loss = 4.4503e-02, PNorm = 281.2879, GNorm = 0.1526, lr_0 = 9.9830e-04
Validation auc = 0.722259
Epoch 2861
Loss = 2.2773e-02, PNorm = 281.3517, GNorm = 1.1485, lr_0 = 9.9829e-04
Validation auc = 0.710507
Epoch 2862
Loss = 4.8325e-02, PNorm = 281.4132, GNorm = 1.4366, lr_0 = 9.9829e-04
Validation auc = 0.705817
Epoch 2863
Loss = 3.5480e-02, PNorm = 281.4862, GNorm = 0.3250, lr_0 = 9.9829e-04
Validation auc = 0.711872
Epoch 2864
Loss = 1.1983e-02, PNorm = 281.5515, GNorm = 0.9251, lr_0 = 9.9829e-04
Validation auc = 0.710595
Epoch 2865
Loss = 6.5090e-03, PNorm = 281.5937, GNorm = 0.0605, lr_0 = 9.9829e-04
Validation auc = 0.711422
Epoch 2866
Loss = 1.4957e-03, PNorm = 281.6215, GNorm = 0.0528, lr_0 = 9.9829e-04
Validation auc = 0.717965
Epoch 2867
Loss = 6.2988e-03, PNorm = 281.6493, GNorm = 0.4290, lr_0 = 9.9829e-04
Validation auc = 0.715866
Epoch 2868
Loss = 1.2630e-03, PNorm = 281.6814, GNorm = 0.1100, lr_0 = 9.9829e-04
Validation auc = 0.719290
Epoch 2869
Loss = 3.8646e-02, PNorm = 281.7166, GNorm = 2.3728, lr_0 = 9.9829e-04
Loss = 1.7629e-02, PNorm = 281.7843, GNorm = 1.0537, lr_0 = 9.9829e-04
Validation auc = 0.722601
Epoch 2870
Loss = 1.0386e-02, PNorm = 281.8383, GNorm = 0.0271, lr_0 = 9.9829e-04
Validation auc = 0.719787
Epoch 2871
Loss = 1.4460e-02, PNorm = 281.8814, GNorm = 1.5341, lr_0 = 9.9829e-04
Validation auc = 0.724570
Epoch 2872
Loss = 7.6612e-02, PNorm = 281.9394, GNorm = 0.3026, lr_0 = 9.9829e-04
Validation auc = 0.715773
Epoch 2873
Loss = 1.6155e-02, PNorm = 282.0235, GNorm = 2.2732, lr_0 = 9.9829e-04
Validation auc = 0.706560
Epoch 2874
Loss = 1.5063e-02, PNorm = 282.1010, GNorm = 0.2471, lr_0 = 9.9828e-04
Validation auc = 0.709242
Epoch 2875
Loss = 2.6176e-02, PNorm = 282.1591, GNorm = 0.1173, lr_0 = 9.9828e-04
Validation auc = 0.710177
Epoch 2876
Loss = 4.0680e-02, PNorm = 282.2108, GNorm = 0.2758, lr_0 = 9.9828e-04
Validation auc = 0.700524
Epoch 2877
Loss = 5.1595e-02, PNorm = 282.2691, GNorm = 0.1325, lr_0 = 9.9828e-04
Validation auc = 0.693972
Epoch 2878
Loss = 6.1759e-02, PNorm = 282.3380, GNorm = 0.8290, lr_0 = 9.9828e-04
Validation auc = 0.698086
Epoch 2879
Loss = 3.1227e-02, PNorm = 282.4011, GNorm = 1.3504, lr_0 = 9.9828e-04
Loss = 6.4659e-02, PNorm = 282.4748, GNorm = 2.9336, lr_0 = 9.9828e-04
Validation auc = 0.705676
Epoch 2880
Loss = 2.8980e-02, PNorm = 282.5626, GNorm = 1.0433, lr_0 = 9.9828e-04
Validation auc = 0.705341
Epoch 2881
Loss = 2.9902e-02, PNorm = 282.6254, GNorm = 0.4582, lr_0 = 9.9828e-04
Validation auc = 0.705351
Epoch 2882
Loss = 2.4227e-02, PNorm = 282.6828, GNorm = 1.1970, lr_0 = 9.9828e-04
Validation auc = 0.704896
Epoch 2883
Loss = 7.0303e-03, PNorm = 282.7251, GNorm = 0.5448, lr_0 = 9.9828e-04
Validation auc = 0.705194
Epoch 2884
Loss = 2.1758e-02, PNorm = 282.7614, GNorm = 0.0238, lr_0 = 9.9828e-04
Validation auc = 0.709086
Epoch 2885
Loss = 1.8361e-02, PNorm = 282.7948, GNorm = 0.1221, lr_0 = 9.9828e-04
Validation auc = 0.712209
Epoch 2886
Loss = 3.7503e-02, PNorm = 282.8423, GNorm = 0.3457, lr_0 = 9.9828e-04
Validation auc = 0.709044
Epoch 2887
Loss = 1.3423e-03, PNorm = 282.8886, GNorm = 0.0324, lr_0 = 9.9828e-04
Validation auc = 0.713010
Epoch 2888
Loss = 7.0177e-02, PNorm = 282.9198, GNorm = 0.0358, lr_0 = 9.9827e-04
Validation auc = 0.715960
Epoch 2889
Loss = 6.0901e-02, PNorm = 282.9603, GNorm = 2.4906, lr_0 = 9.9827e-04
Loss = 1.0316e-02, PNorm = 283.0087, GNorm = 0.0704, lr_0 = 9.9827e-04
Validation auc = 0.708706
Epoch 2890
Loss = 1.6139e-02, PNorm = 283.0500, GNorm = 1.5382, lr_0 = 9.9827e-04
Validation auc = 0.710605
Epoch 2891
Loss = 1.0345e-02, PNorm = 283.1028, GNorm = 0.1430, lr_0 = 9.9827e-04
Validation auc = 0.710390
Epoch 2892
Loss = 5.8175e-03, PNorm = 283.1523, GNorm = 0.0243, lr_0 = 9.9827e-04
Validation auc = 0.708917
Epoch 2893
Loss = 2.9040e-02, PNorm = 283.1957, GNorm = 1.3437, lr_0 = 9.9827e-04
Validation auc = 0.705910
Epoch 2894
Loss = 1.8491e-02, PNorm = 283.2524, GNorm = 0.0435, lr_0 = 9.9827e-04
Validation auc = 0.700054
Epoch 2895
Loss = 2.3207e-02, PNorm = 283.3280, GNorm = 0.0833, lr_0 = 9.9827e-04
Validation auc = 0.700766
Epoch 2896
Loss = 1.4711e-02, PNorm = 283.3939, GNorm = 0.4160, lr_0 = 9.9827e-04
Validation auc = 0.701342
Epoch 2897
Loss = 6.6660e-02, PNorm = 283.4662, GNorm = 1.8090, lr_0 = 9.9827e-04
Validation auc = 0.703006
Epoch 2898
Loss = 1.4655e-02, PNorm = 283.5288, GNorm = 0.3376, lr_0 = 9.9827e-04
Validation auc = 0.705650
Epoch 2899
Loss = 7.5886e-02, PNorm = 283.5769, GNorm = 1.3632, lr_0 = 9.9827e-04
Loss = 3.0875e-02, PNorm = 283.6298, GNorm = 0.5840, lr_0 = 9.9827e-04
Validation auc = 0.707103
Epoch 2900
Loss = 1.7675e-02, PNorm = 283.6790, GNorm = 1.8987, lr_0 = 9.9827e-04
Validation auc = 0.707143
Epoch 2901
Loss = 5.3916e-02, PNorm = 283.7426, GNorm = 0.4272, lr_0 = 9.9826e-04
Validation auc = 0.711762
Epoch 2902
Loss = 7.6161e-02, PNorm = 283.8271, GNorm = 0.7421, lr_0 = 9.9826e-04
Validation auc = 0.718196
Epoch 2903
Loss = 1.7886e-02, PNorm = 283.8915, GNorm = 1.1545, lr_0 = 9.9826e-04
Validation auc = 0.718382
Epoch 2904
Loss = 2.0632e-02, PNorm = 283.9444, GNorm = 0.8109, lr_0 = 9.9826e-04
Validation auc = 0.710844
Epoch 2905
Loss = 2.6485e-02, PNorm = 283.9941, GNorm = 1.4046, lr_0 = 9.9826e-04
Validation auc = 0.716425
Epoch 2906
Loss = 3.9941e-02, PNorm = 284.0469, GNorm = 0.2936, lr_0 = 9.9826e-04
Validation auc = 0.719773
Epoch 2907
Loss = 8.0150e-03, PNorm = 284.0990, GNorm = 0.1770, lr_0 = 9.9826e-04
Validation auc = 0.719333
Epoch 2908
Loss = 6.3005e-03, PNorm = 284.1410, GNorm = 0.5339, lr_0 = 9.9826e-04
Validation auc = 0.714098
Epoch 2909
Loss = 1.8129e-02, PNorm = 284.1786, GNorm = 0.8727, lr_0 = 9.9826e-04
Loss = 8.0150e-03, PNorm = 284.2180, GNorm = 0.0675, lr_0 = 9.9826e-04
Validation auc = 0.710130
Epoch 2910
Loss = 3.7043e-03, PNorm = 284.2459, GNorm = 0.0306, lr_0 = 9.9826e-04
Validation auc = 0.712738
Epoch 2911
Loss = 2.8637e-02, PNorm = 284.2708, GNorm = 0.2727, lr_0 = 9.9826e-04
Validation auc = 0.714359
Epoch 2912
Loss = 7.0205e-03, PNorm = 284.3195, GNorm = 0.1211, lr_0 = 9.9826e-04
Validation auc = 0.712665
Epoch 2913
Loss = 4.3107e-02, PNorm = 284.3643, GNorm = 0.9138, lr_0 = 9.9826e-04
Validation auc = 0.709699
Epoch 2914
Loss = 4.1016e-02, PNorm = 284.4224, GNorm = 0.1097, lr_0 = 9.9825e-04
Validation auc = 0.689791
Epoch 2915
Loss = 1.4469e-02, PNorm = 284.4884, GNorm = 1.5402, lr_0 = 9.9825e-04
Validation auc = 0.685258
Epoch 2916
Loss = 8.1772e-03, PNorm = 284.5357, GNorm = 0.3657, lr_0 = 9.9825e-04
Validation auc = 0.682953
Epoch 2917
Loss = 1.1275e-01, PNorm = 284.5768, GNorm = 4.8353, lr_0 = 9.9825e-04
Validation auc = 0.696446
Epoch 2918
Loss = 7.2929e-02, PNorm = 284.6287, GNorm = 3.0485, lr_0 = 9.9825e-04
Validation auc = 0.696330
Epoch 2919
Loss = 2.7514e-02, PNorm = 284.6965, GNorm = 0.9856, lr_0 = 9.9825e-04
Loss = 2.8720e-02, PNorm = 284.7618, GNorm = 0.0634, lr_0 = 9.9825e-04
Validation auc = 0.716023
Epoch 2920
Loss = 1.3639e-02, PNorm = 284.8169, GNorm = 2.4888, lr_0 = 9.9825e-04
Validation auc = 0.710593
Epoch 2921
Loss = 4.4062e-02, PNorm = 284.8651, GNorm = 0.0414, lr_0 = 9.9825e-04
Validation auc = 0.704474
Epoch 2922
Loss = 1.3409e-02, PNorm = 284.9059, GNorm = 0.1182, lr_0 = 9.9825e-04
Validation auc = 0.703863
Epoch 2923
Loss = 7.3493e-03, PNorm = 284.9367, GNorm = 0.1446, lr_0 = 9.9825e-04
Validation auc = 0.698725
Epoch 2924
Loss = 4.3096e-03, PNorm = 284.9685, GNorm = 0.0789, lr_0 = 9.9825e-04
Validation auc = 0.684414
Epoch 2925
Loss = 2.1091e-02, PNorm = 285.0110, GNorm = 0.8951, lr_0 = 9.9825e-04
Validation auc = 0.672554
Epoch 2926
Loss = 3.0794e-03, PNorm = 285.0831, GNorm = 0.3296, lr_0 = 9.9825e-04
Validation auc = 0.666904
Epoch 2927
Loss = 2.3913e-02, PNorm = 285.1388, GNorm = 1.4220, lr_0 = 9.9825e-04
Validation auc = 0.672766
Epoch 2928
Loss = 3.0666e-02, PNorm = 285.1793, GNorm = 1.1074, lr_0 = 9.9824e-04
Validation auc = 0.680252
Epoch 2929
Loss = 5.7492e-03, PNorm = 285.2213, GNorm = 0.1796, lr_0 = 9.9824e-04
Loss = 2.5076e-02, PNorm = 285.2667, GNorm = 1.3013, lr_0 = 9.9824e-04
Validation auc = 0.687881
Epoch 2930
Loss = 1.0341e-02, PNorm = 285.3054, GNorm = 0.7193, lr_0 = 9.9824e-04
Validation auc = 0.697793
Epoch 2931
Loss = 1.3860e-02, PNorm = 285.3421, GNorm = 0.9560, lr_0 = 9.9824e-04
Validation auc = 0.692395
Epoch 2932
Loss = 1.7672e-02, PNorm = 285.3782, GNorm = 0.1645, lr_0 = 9.9824e-04
Validation auc = 0.694907
Epoch 2933
Loss = 3.8955e-02, PNorm = 285.4221, GNorm = 0.0289, lr_0 = 9.9824e-04
Validation auc = 0.699771
Epoch 2934
Loss = 3.2512e-02, PNorm = 285.4610, GNorm = 1.6763, lr_0 = 9.9824e-04
Validation auc = 0.703817
Epoch 2935
Loss = 1.1190e-02, PNorm = 285.5032, GNorm = 0.0356, lr_0 = 9.9824e-04
Validation auc = 0.697850
Epoch 2936
Loss = 1.0737e-02, PNorm = 285.5409, GNorm = 0.7420, lr_0 = 9.9824e-04
Validation auc = 0.683815
Epoch 2937
Loss = 2.4164e-02, PNorm = 285.5782, GNorm = 0.8507, lr_0 = 9.9824e-04
Validation auc = 0.682665
Epoch 2938
Loss = 3.4967e-02, PNorm = 285.6181, GNorm = 0.9645, lr_0 = 9.9824e-04
Validation auc = 0.684735
Epoch 2939
Loss = 1.0075e-01, PNorm = 285.6593, GNorm = 1.3401, lr_0 = 9.9824e-04
Loss = 1.2854e-02, PNorm = 285.7041, GNorm = 0.0538, lr_0 = 9.9824e-04
Validation auc = 0.687432
Epoch 2940
Loss = 1.6587e-02, PNorm = 285.7438, GNorm = 0.0284, lr_0 = 9.9823e-04
Validation auc = 0.689893
Epoch 2941
Loss = 3.0167e-02, PNorm = 285.7771, GNorm = 1.0578, lr_0 = 9.9823e-04
Validation auc = 0.690016
Epoch 2942
Loss = 3.2390e-02, PNorm = 285.8119, GNorm = 1.2316, lr_0 = 9.9823e-04
Validation auc = 0.691973
Epoch 2943
Loss = 1.2965e-02, PNorm = 285.8550, GNorm = 0.0792, lr_0 = 9.9823e-04
Validation auc = 0.695048
Epoch 2944
Loss = 1.6919e-03, PNorm = 285.8953, GNorm = 0.0124, lr_0 = 9.9823e-04
Validation auc = 0.695745
Epoch 2945
Loss = 1.9245e-02, PNorm = 285.9238, GNorm = 1.0322, lr_0 = 9.9823e-04
Validation auc = 0.699538
Epoch 2946
Loss = 9.5090e-03, PNorm = 285.9636, GNorm = 0.1826, lr_0 = 9.9823e-04
Validation auc = 0.694863
Epoch 2947
Loss = 1.0676e-02, PNorm = 286.0044, GNorm = 0.9737, lr_0 = 9.9823e-04
Validation auc = 0.693448
Epoch 2948
Loss = 2.8198e-03, PNorm = 286.0337, GNorm = 0.0932, lr_0 = 9.9823e-04
Validation auc = 0.694614
Epoch 2949
Loss = 1.9723e-03, PNorm = 286.0739, GNorm = 0.0701, lr_0 = 9.9823e-04
Loss = 1.7000e-02, PNorm = 286.1171, GNorm = 0.0713, lr_0 = 9.9823e-04
Validation auc = 0.693182
Epoch 2950
Loss = 1.2945e-02, PNorm = 286.1602, GNorm = 0.5345, lr_0 = 9.9823e-04
Validation auc = 0.692186
Epoch 2951
Loss = 3.0206e-02, PNorm = 286.2133, GNorm = 0.0743, lr_0 = 9.9823e-04
Validation auc = 0.692904
Epoch 2952
Loss = 1.3276e-02, PNorm = 286.2668, GNorm = 0.0374, lr_0 = 9.9823e-04
Validation auc = 0.694641
Epoch 2953
Loss = 2.1681e-02, PNorm = 286.3106, GNorm = 0.3346, lr_0 = 9.9823e-04
Validation auc = 0.688324
Epoch 2954
Loss = 1.0208e-02, PNorm = 286.3485, GNorm = 0.3024, lr_0 = 9.9822e-04
Validation auc = 0.684036
Epoch 2955
Loss = 8.8613e-03, PNorm = 286.3975, GNorm = 0.4071, lr_0 = 9.9822e-04
Validation auc = 0.678481
Epoch 2956
Loss = 2.1946e-02, PNorm = 286.4495, GNorm = 0.1985, lr_0 = 9.9822e-04
Validation auc = 0.679662
Epoch 2957
Loss = 5.5473e-02, PNorm = 286.4930, GNorm = 0.8750, lr_0 = 9.9822e-04
Validation auc = 0.681223
Epoch 2958
Loss = 1.2558e-02, PNorm = 286.5545, GNorm = 0.7396, lr_0 = 9.9822e-04
Validation auc = 0.679824
Epoch 2959
Loss = 6.7621e-02, PNorm = 286.6138, GNorm = 0.8876, lr_0 = 9.9822e-04
Loss = 2.9513e-02, PNorm = 286.6588, GNorm = 0.3797, lr_0 = 9.9822e-04
Validation auc = 0.681227
Epoch 2960
Loss = 3.6661e-02, PNorm = 286.7164, GNorm = 1.8155, lr_0 = 9.9822e-04
Validation auc = 0.691083
Epoch 2961
Loss = 1.3317e-02, PNorm = 286.7676, GNorm = 0.0366, lr_0 = 9.9822e-04
Validation auc = 0.704134
Epoch 2962
Loss = 3.1085e-02, PNorm = 286.8147, GNorm = 0.3668, lr_0 = 9.9822e-04
Validation auc = 0.707963
Epoch 2963
Loss = 1.4325e-02, PNorm = 286.8689, GNorm = 0.2935, lr_0 = 9.9822e-04
Validation auc = 0.710900
Epoch 2964
Loss = 2.6285e-02, PNorm = 286.9165, GNorm = 0.2399, lr_0 = 9.9822e-04
Validation auc = 0.704438
Epoch 2965
Loss = 2.0036e-02, PNorm = 286.9602, GNorm = 0.7699, lr_0 = 9.9822e-04
Validation auc = 0.699563
Epoch 2966
Loss = 4.5526e-02, PNorm = 287.0034, GNorm = 1.0044, lr_0 = 9.9822e-04
Validation auc = 0.710631
Epoch 2967
Loss = 1.2147e-02, PNorm = 287.0463, GNorm = 0.7430, lr_0 = 9.9821e-04
Validation auc = 0.709811
Epoch 2968
Loss = 3.3894e-03, PNorm = 287.0939, GNorm = 0.0683, lr_0 = 9.9821e-04
Validation auc = 0.701369
Epoch 2969
Loss = 4.7432e-02, PNorm = 287.1310, GNorm = 1.4807, lr_0 = 9.9821e-04
Loss = 3.8745e-02, PNorm = 287.1765, GNorm = 1.1596, lr_0 = 9.9821e-04
Validation auc = 0.696844
Epoch 2970
Loss = 1.6959e-02, PNorm = 287.2324, GNorm = 1.3108, lr_0 = 9.9821e-04
Validation auc = 0.694390
Epoch 2971
Loss = 5.1219e-02, PNorm = 287.2786, GNorm = 2.8197, lr_0 = 9.9821e-04
Validation auc = 0.691393
Epoch 2972
Loss = 3.1146e-02, PNorm = 287.3458, GNorm = 0.4298, lr_0 = 9.9821e-04
Validation auc = 0.690250
Epoch 2973
Loss = 3.2430e-02, PNorm = 287.4140, GNorm = 0.3174, lr_0 = 9.9821e-04
Validation auc = 0.683088
Epoch 2974
Loss = 2.6380e-02, PNorm = 287.4723, GNorm = 1.2317, lr_0 = 9.9821e-04
Validation auc = 0.683470
Epoch 2975
Loss = 3.9257e-02, PNorm = 287.5199, GNorm = 1.1055, lr_0 = 9.9821e-04
Validation auc = 0.682113
Epoch 2976
Loss = 2.9411e-02, PNorm = 287.5601, GNorm = 0.1378, lr_0 = 9.9821e-04
Validation auc = 0.685441
Epoch 2977
Loss = 3.7610e-02, PNorm = 287.6048, GNorm = 0.3429, lr_0 = 9.9821e-04
Validation auc = 0.682502
Epoch 2978
Loss = 3.2565e-02, PNorm = 287.6443, GNorm = 0.7737, lr_0 = 9.9821e-04
Validation auc = 0.675979
Epoch 2979
Loss = 4.5031e-04, PNorm = 287.6818, GNorm = 0.0223, lr_0 = 9.9821e-04
Loss = 1.3854e-02, PNorm = 287.7184, GNorm = 0.0701, lr_0 = 9.9821e-04
Validation auc = 0.676436
Epoch 2980
Loss = 1.5503e-02, PNorm = 287.7539, GNorm = 0.0383, lr_0 = 9.9820e-04
Validation auc = 0.681957
Epoch 2981
Loss = 1.3302e-02, PNorm = 287.8041, GNorm = 0.1628, lr_0 = 9.9820e-04
Validation auc = 0.684137
Epoch 2982
Loss = 1.2216e-02, PNorm = 287.8394, GNorm = 0.0875, lr_0 = 9.9820e-04
Validation auc = 0.686503
Epoch 2983
Loss = 3.0896e-02, PNorm = 287.8740, GNorm = 0.1477, lr_0 = 9.9820e-04
Validation auc = 0.680951
Epoch 2984
Loss = 1.7757e-02, PNorm = 287.9175, GNorm = 1.1751, lr_0 = 9.9820e-04
Validation auc = 0.680753
Epoch 2985
Loss = 2.5241e-02, PNorm = 287.9573, GNorm = 2.1220, lr_0 = 9.9820e-04
Validation auc = 0.683034
Epoch 2986
Loss = 1.4799e-02, PNorm = 288.0034, GNorm = 0.0809, lr_0 = 9.9820e-04
Validation auc = 0.683568
Epoch 2987
Loss = 7.3341e-03, PNorm = 288.0439, GNorm = 0.2089, lr_0 = 9.9820e-04
Validation auc = 0.690077
Epoch 2988
Loss = 4.1394e-03, PNorm = 288.0899, GNorm = 0.3902, lr_0 = 9.9820e-04
Validation auc = 0.691346
Epoch 2989
Loss = 8.9871e-05, PNorm = 288.1374, GNorm = 0.0042, lr_0 = 9.9820e-04
Loss = 1.4773e-02, PNorm = 288.1858, GNorm = 0.0482, lr_0 = 9.9820e-04
Validation auc = 0.691002
Epoch 2990
Loss = 3.3417e-02, PNorm = 288.2219, GNorm = 0.1111, lr_0 = 9.9820e-04
Validation auc = 0.689768
Epoch 2991
Loss = 2.1347e-02, PNorm = 288.2659, GNorm = 1.4250, lr_0 = 9.9820e-04
Validation auc = 0.696669
Epoch 2992
Loss = 3.8928e-02, PNorm = 288.3153, GNorm = 1.7876, lr_0 = 9.9820e-04
Validation auc = 0.703317
Epoch 2993
Loss = 3.5288e-02, PNorm = 288.3827, GNorm = 4.1493, lr_0 = 9.9819e-04
Validation auc = 0.703388
Epoch 2994
Loss = 4.5942e-02, PNorm = 288.4555, GNorm = 0.0405, lr_0 = 9.9819e-04
Validation auc = 0.701490
Epoch 2995
Loss = 2.2159e-02, PNorm = 288.5149, GNorm = 0.2789, lr_0 = 9.9819e-04
Validation auc = 0.705242
Epoch 2996
Loss = 2.4507e-02, PNorm = 288.5835, GNorm = 1.9201, lr_0 = 9.9819e-04
Validation auc = 0.703142
Epoch 2997
Loss = 2.6478e-02, PNorm = 288.6663, GNorm = 1.3290, lr_0 = 9.9819e-04
Validation auc = 0.701864
Epoch 2998
Loss = 2.2862e-02, PNorm = 288.7363, GNorm = 3.4035, lr_0 = 9.9819e-04
Validation auc = 0.705025
Epoch 2999
Loss = 6.1997e-03, PNorm = 288.8058, GNorm = 0.2085, lr_0 = 9.9819e-04
Loss = 4.7396e-02, PNorm = 288.8812, GNorm = 0.1072, lr_0 = 9.9819e-04
Validation auc = 0.704498
Epoch 3000
Loss = 3.4903e-02, PNorm = 288.9765, GNorm = 0.2225, lr_0 = 9.9819e-04
Validation auc = 0.697382
Epoch 3001
Loss = 2.9153e-02, PNorm = 289.0581, GNorm = 0.6836, lr_0 = 9.9819e-04
Validation auc = 0.706905
Epoch 3002
Loss = 1.7558e-02, PNorm = 289.1295, GNorm = 0.1171, lr_0 = 9.9819e-04
Validation auc = 0.709859
Epoch 3003
Loss = 1.4273e-02, PNorm = 289.1876, GNorm = 0.1163, lr_0 = 9.9819e-04
Validation auc = 0.706637
Epoch 3004
Loss = 1.9501e-02, PNorm = 289.2383, GNorm = 0.1902, lr_0 = 9.9819e-04
Validation auc = 0.706123
Epoch 3005
Loss = 4.9113e-02, PNorm = 289.2936, GNorm = 0.1779, lr_0 = 9.9819e-04
Validation auc = 0.700456
Epoch 3006
Loss = 1.1817e-02, PNorm = 289.3599, GNorm = 0.2799, lr_0 = 9.9819e-04
Validation auc = 0.697438
Epoch 3007
Loss = 6.1760e-02, PNorm = 289.4200, GNorm = 2.7058, lr_0 = 9.9818e-04
Validation auc = 0.703923
Epoch 3008
Loss = 1.1084e-02, PNorm = 289.4862, GNorm = 1.1561, lr_0 = 9.9818e-04
Validation auc = 0.696783
Epoch 3009
Loss = 1.1291e-02, PNorm = 289.5542, GNorm = 0.4710, lr_0 = 9.9818e-04
Loss = 4.0518e-02, PNorm = 289.6219, GNorm = 0.3069, lr_0 = 9.9818e-04
Validation auc = 0.694973
Epoch 3010
Loss = 5.1259e-02, PNorm = 289.6851, GNorm = 0.2956, lr_0 = 9.9818e-04
Validation auc = 0.689579
Epoch 3011
Loss = 1.5660e-02, PNorm = 289.7608, GNorm = 0.5351, lr_0 = 9.9818e-04
Validation auc = 0.694269
Epoch 3012
Loss = 3.3457e-02, PNorm = 289.8264, GNorm = 0.0647, lr_0 = 9.9818e-04
Validation auc = 0.695353
Epoch 3013
Loss = 2.6517e-02, PNorm = 289.8879, GNorm = 1.0772, lr_0 = 9.9818e-04
Validation auc = 0.706510
Epoch 3014
Loss = 4.3992e-02, PNorm = 289.9475, GNorm = 1.2909, lr_0 = 9.9818e-04
Validation auc = 0.704318
Epoch 3015
Loss = 4.7137e-02, PNorm = 290.0105, GNorm = 1.1005, lr_0 = 9.9818e-04
Validation auc = 0.707422
Epoch 3016
Loss = 1.6268e-02, PNorm = 290.0715, GNorm = 0.7376, lr_0 = 9.9818e-04
Validation auc = 0.702607
Epoch 3017
Loss = 1.4422e-02, PNorm = 290.1209, GNorm = 0.1735, lr_0 = 9.9818e-04
Validation auc = 0.705861
Epoch 3018
Loss = 2.9921e-02, PNorm = 290.1614, GNorm = 0.8215, lr_0 = 9.9818e-04
Validation auc = 0.705491
Epoch 3019
Loss = 5.9952e-03, PNorm = 290.2098, GNorm = 0.1429, lr_0 = 9.9818e-04
Loss = 2.8879e-02, PNorm = 290.2540, GNorm = 0.3258, lr_0 = 9.9817e-04
Validation auc = 0.707512
Epoch 3020
Loss = 2.3412e-02, PNorm = 290.2978, GNorm = 0.1172, lr_0 = 9.9817e-04
Validation auc = 0.714298
Epoch 3021
Loss = 1.7763e-02, PNorm = 290.3326, GNorm = 1.9335, lr_0 = 9.9817e-04
Validation auc = 0.715420
Epoch 3022
Loss = 7.6410e-03, PNorm = 290.3630, GNorm = 0.1225, lr_0 = 9.9817e-04
Validation auc = 0.714433
Epoch 3023
Loss = 1.1850e-02, PNorm = 290.3916, GNorm = 0.8604, lr_0 = 9.9817e-04
Validation auc = 0.715978
Epoch 3024
Loss = 3.3529e-02, PNorm = 290.4188, GNorm = 0.3040, lr_0 = 9.9817e-04
Validation auc = 0.710765
Epoch 3025
Loss = 1.5104e-02, PNorm = 290.4619, GNorm = 1.2794, lr_0 = 9.9817e-04
Validation auc = 0.715156
Epoch 3026
Loss = 2.2916e-02, PNorm = 290.5019, GNorm = 1.8622, lr_0 = 9.9817e-04
Validation auc = 0.713788
Epoch 3027
Loss = 3.1221e-02, PNorm = 290.5439, GNorm = 0.0909, lr_0 = 9.9817e-04
Validation auc = 0.715439
Epoch 3028
Loss = 2.0180e-02, PNorm = 290.5925, GNorm = 1.3555, lr_0 = 9.9817e-04
Validation auc = 0.708446
Epoch 3029
Loss = 6.3134e-03, PNorm = 290.6293, GNorm = 0.2881, lr_0 = 9.9817e-04
Loss = 2.3537e-02, PNorm = 290.6553, GNorm = 1.2840, lr_0 = 9.9817e-04
Validation auc = 0.709365
Epoch 3030
Loss = 5.4869e-02, PNorm = 290.6952, GNorm = 1.4819, lr_0 = 9.9817e-04
Validation auc = 0.718174
Epoch 3031
Loss = 2.2155e-02, PNorm = 290.7500, GNorm = 0.1266, lr_0 = 9.9817e-04
Validation auc = 0.722196
Epoch 3032
Loss = 1.0973e-02, PNorm = 290.7969, GNorm = 0.0433, lr_0 = 9.9817e-04
Validation auc = 0.722926
Epoch 3033
Loss = 6.1295e-03, PNorm = 290.8335, GNorm = 0.3893, lr_0 = 9.9816e-04
Validation auc = 0.721877
Epoch 3034
Loss = 1.3689e-02, PNorm = 290.8662, GNorm = 1.1825, lr_0 = 9.9816e-04
Validation auc = 0.713135
Epoch 3035
Loss = 1.4291e-02, PNorm = 290.8988, GNorm = 0.0284, lr_0 = 9.9816e-04
Validation auc = 0.706233
Epoch 3036
Loss = 3.2266e-02, PNorm = 290.9370, GNorm = 1.6544, lr_0 = 9.9816e-04
Validation auc = 0.705929
Epoch 3037
Loss = 3.3113e-02, PNorm = 290.9926, GNorm = 0.4930, lr_0 = 9.9816e-04
Validation auc = 0.713938
Epoch 3038
Loss = 5.3879e-03, PNorm = 291.0529, GNorm = 0.2968, lr_0 = 9.9816e-04
Validation auc = 0.712291
Epoch 3039
Loss = 2.5751e-03, PNorm = 291.1032, GNorm = 0.0744, lr_0 = 9.9816e-04
Loss = 1.7818e-02, PNorm = 291.1477, GNorm = 0.9209, lr_0 = 9.9816e-04
Validation auc = 0.714384
Epoch 3040
Loss = 2.3093e-02, PNorm = 291.2001, GNorm = 0.0572, lr_0 = 9.9816e-04
Validation auc = 0.719585
Epoch 3041
Loss = 2.8696e-02, PNorm = 291.2405, GNorm = 0.2506, lr_0 = 9.9816e-04
Validation auc = 0.721815
Epoch 3042
Loss = 1.6354e-02, PNorm = 291.2776, GNorm = 1.7606, lr_0 = 9.9816e-04
Validation auc = 0.718586
Epoch 3043
Loss = 3.3458e-02, PNorm = 291.3285, GNorm = 2.0850, lr_0 = 9.9816e-04
Validation auc = 0.709467
Epoch 3044
Loss = 3.0614e-02, PNorm = 291.3846, GNorm = 0.2991, lr_0 = 9.9816e-04
Validation auc = 0.705167
Epoch 3045
Loss = 3.3250e-02, PNorm = 291.4370, GNorm = 0.0549, lr_0 = 9.9816e-04
Validation auc = 0.705070
Epoch 3046
Loss = 9.4517e-02, PNorm = 291.5013, GNorm = 1.1625, lr_0 = 9.9816e-04
Validation auc = 0.701928
Epoch 3047
Loss = 6.3655e-03, PNorm = 291.5688, GNorm = 0.0934, lr_0 = 9.9815e-04
Validation auc = 0.695890
Epoch 3048
Loss = 8.5143e-03, PNorm = 291.6233, GNorm = 0.1414, lr_0 = 9.9815e-04
Validation auc = 0.711808
Epoch 3049
Loss = 5.1806e-02, PNorm = 291.6795, GNorm = 2.5236, lr_0 = 9.9815e-04
Loss = 4.6416e-02, PNorm = 291.7536, GNorm = 1.9979, lr_0 = 9.9815e-04
Validation auc = 0.715022
Epoch 3050
Loss = 3.5002e-02, PNorm = 291.8271, GNorm = 0.4932, lr_0 = 9.9815e-04
Validation auc = 0.708812
Epoch 3051
Loss = 5.6157e-02, PNorm = 291.8978, GNorm = 0.7184, lr_0 = 9.9815e-04
Validation auc = 0.717869
Epoch 3052
Loss = 3.4353e-02, PNorm = 291.9792, GNorm = 0.7331, lr_0 = 9.9815e-04
Validation auc = 0.731204
Epoch 3053
Loss = 3.9101e-02, PNorm = 292.0406, GNorm = 1.5336, lr_0 = 9.9815e-04
Validation auc = 0.739399
Epoch 3054
Loss = 1.4317e-02, PNorm = 292.0858, GNorm = 0.2868, lr_0 = 9.9815e-04
Validation auc = 0.740572
Epoch 3055
Loss = 5.7545e-02, PNorm = 292.1256, GNorm = 3.3872, lr_0 = 9.9815e-04
Validation auc = 0.737505
Epoch 3056
Loss = 2.6351e-02, PNorm = 292.1643, GNorm = 0.3979, lr_0 = 9.9815e-04
Validation auc = 0.734762
Epoch 3057
Loss = 1.0351e-01, PNorm = 292.1985, GNorm = 1.4403, lr_0 = 9.9815e-04
Validation auc = 0.730433
Epoch 3058
Loss = 4.2639e-02, PNorm = 292.2397, GNorm = 0.1802, lr_0 = 9.9815e-04
Validation auc = 0.729808
Epoch 3059
Loss = 1.0991e-01, PNorm = 292.2833, GNorm = 1.4115, lr_0 = 9.9815e-04
Loss = 2.6475e-02, PNorm = 292.3278, GNorm = 1.1974, lr_0 = 9.9814e-04
Validation auc = 0.730215
Epoch 3060
Loss = 2.7902e-02, PNorm = 292.3691, GNorm = 1.0117, lr_0 = 9.9814e-04
Validation auc = 0.732545
Epoch 3061
Loss = 3.0844e-02, PNorm = 292.4093, GNorm = 1.5583, lr_0 = 9.9814e-04
Validation auc = 0.733155
Epoch 3062
Loss = 1.1072e-02, PNorm = 292.4515, GNorm = 0.5689, lr_0 = 9.9814e-04
Validation auc = 0.730145
Epoch 3063
Loss = 2.5592e-02, PNorm = 292.4919, GNorm = 0.0529, lr_0 = 9.9814e-04
Validation auc = 0.733974
Epoch 3064
Loss = 1.3379e-02, PNorm = 292.5364, GNorm = 0.0227, lr_0 = 9.9814e-04
Validation auc = 0.727214
Epoch 3065
Loss = 3.7808e-03, PNorm = 292.5872, GNorm = 0.2374, lr_0 = 9.9814e-04
Validation auc = 0.725147
Epoch 3066
Loss = 2.7900e-03, PNorm = 292.6260, GNorm = 0.0336, lr_0 = 9.9814e-04
Validation auc = 0.725980
Epoch 3067
Loss = 7.9896e-02, PNorm = 292.6575, GNorm = 3.8035, lr_0 = 9.9814e-04
Validation auc = 0.731057
Epoch 3068
Loss = 9.5644e-04, PNorm = 292.7009, GNorm = 0.0370, lr_0 = 9.9814e-04
Validation auc = 0.734560
Epoch 3069
Loss = 1.3982e-03, PNorm = 292.7448, GNorm = 0.0591, lr_0 = 9.9814e-04
Loss = 2.2415e-02, PNorm = 292.7835, GNorm = 0.2038, lr_0 = 9.9814e-04
Validation auc = 0.737766
Epoch 3070
Loss = 3.6341e-02, PNorm = 292.8257, GNorm = 1.3241, lr_0 = 9.9814e-04
Validation auc = 0.734713
Epoch 3071
Loss = 6.0410e-02, PNorm = 292.8839, GNorm = 1.0473, lr_0 = 9.9814e-04
Validation auc = 0.729023
Epoch 3072
Loss = 2.9318e-02, PNorm = 292.9562, GNorm = 0.0828, lr_0 = 9.9814e-04
Validation auc = 0.729465
Epoch 3073
Loss = 5.8208e-02, PNorm = 293.0143, GNorm = 0.2982, lr_0 = 9.9813e-04
Validation auc = 0.727661
Epoch 3074
Loss = 1.4319e-02, PNorm = 293.0739, GNorm = 0.1736, lr_0 = 9.9813e-04
Validation auc = 0.726932
Epoch 3075
Loss = 4.4067e-03, PNorm = 293.1183, GNorm = 0.0278, lr_0 = 9.9813e-04
Validation auc = 0.725406
Epoch 3076
Loss = 5.9327e-03, PNorm = 293.1550, GNorm = 0.2612, lr_0 = 9.9813e-04
Validation auc = 0.724855
Epoch 3077
Loss = 4.0628e-02, PNorm = 293.2021, GNorm = 2.2985, lr_0 = 9.9813e-04
Validation auc = 0.729267
Epoch 3078
Loss = 1.3688e-01, PNorm = 293.2662, GNorm = 2.2286, lr_0 = 9.9813e-04
Validation auc = 0.733970
Epoch 3079
Loss = 9.0685e-03, PNorm = 293.3307, GNorm = 0.3481, lr_0 = 9.9813e-04
Loss = 2.6883e-02, PNorm = 293.3829, GNorm = 0.2215, lr_0 = 9.9813e-04
Validation auc = 0.740442
Epoch 3080
Loss = 1.3321e-02, PNorm = 293.4298, GNorm = 1.3259, lr_0 = 9.9813e-04
Validation auc = 0.743733
Epoch 3081
Loss = 2.1130e-02, PNorm = 293.4710, GNorm = 0.1434, lr_0 = 9.9813e-04
Validation auc = 0.741097
Epoch 3082
Loss = 1.0242e-02, PNorm = 293.5123, GNorm = 0.0439, lr_0 = 9.9813e-04
Validation auc = 0.742211
Epoch 3083
Loss = 3.4381e-02, PNorm = 293.5634, GNorm = 1.0311, lr_0 = 9.9813e-04
Validation auc = 0.737902
Epoch 3084
Loss = 4.1362e-02, PNorm = 293.6326, GNorm = 3.0345, lr_0 = 9.9813e-04
Validation auc = 0.728100
Epoch 3085
Loss = 4.1128e-03, PNorm = 293.6910, GNorm = 0.2036, lr_0 = 9.9813e-04
Validation auc = 0.732091
Epoch 3086
Loss = 5.8152e-02, PNorm = 293.7347, GNorm = 0.0921, lr_0 = 9.9812e-04
Validation auc = 0.720569
Epoch 3087
Loss = 5.6121e-03, PNorm = 293.7867, GNorm = 0.1391, lr_0 = 9.9812e-04
Validation auc = 0.716821
Epoch 3088
Loss = 8.7327e-03, PNorm = 293.8339, GNorm = 0.0935, lr_0 = 9.9812e-04
Validation auc = 0.716111
Epoch 3089
Loss = 6.7083e-03, PNorm = 293.8689, GNorm = 0.2654, lr_0 = 9.9812e-04
Loss = 2.5242e-02, PNorm = 293.8991, GNorm = 2.8496, lr_0 = 9.9812e-04
Validation auc = 0.714744
Epoch 3090
Loss = 3.3740e-02, PNorm = 293.9479, GNorm = 0.9519, lr_0 = 9.9812e-04
Validation auc = 0.713164
Epoch 3091
Loss = 2.0193e-02, PNorm = 294.0003, GNorm = 0.0496, lr_0 = 9.9812e-04
Validation auc = 0.710975
Epoch 3092
Loss = 1.3137e-02, PNorm = 294.0336, GNorm = 0.0797, lr_0 = 9.9812e-04
Validation auc = 0.709798
Epoch 3093
Loss = 6.2629e-03, PNorm = 294.0618, GNorm = 0.0585, lr_0 = 9.9812e-04
Validation auc = 0.706031
Epoch 3094
Loss = 1.4264e-02, PNorm = 294.0917, GNorm = 1.6529, lr_0 = 9.9812e-04
Validation auc = 0.702208
Epoch 3095
Loss = 4.9288e-03, PNorm = 294.1283, GNorm = 0.6119, lr_0 = 9.9812e-04
Validation auc = 0.697920
Epoch 3096
Loss = 3.1075e-03, PNorm = 294.1673, GNorm = 0.2531, lr_0 = 9.9812e-04
Validation auc = 0.700347
Epoch 3097
Loss = 1.2293e-02, PNorm = 294.1984, GNorm = 0.8351, lr_0 = 9.9812e-04
Validation auc = 0.696349
Epoch 3098
Loss = 5.7285e-02, PNorm = 294.2384, GNorm = 1.4000, lr_0 = 9.9812e-04
Validation auc = 0.701412
Epoch 3099
Loss = 3.5255e-02, PNorm = 294.2807, GNorm = 1.7759, lr_0 = 9.9812e-04
Loss = 5.0461e-02, PNorm = 294.3444, GNorm = 0.4434, lr_0 = 9.9811e-04
Validation auc = 0.708934
Epoch 3100
Loss = 2.9192e-02, PNorm = 294.4167, GNorm = 0.9104, lr_0 = 9.9811e-04
Validation auc = 0.717208
Epoch 3101
Loss = 3.7132e-02, PNorm = 294.4915, GNorm = 0.6256, lr_0 = 9.9811e-04
Validation auc = 0.719893
Epoch 3102
Loss = 3.4888e-02, PNorm = 294.5554, GNorm = 0.1044, lr_0 = 9.9811e-04
Validation auc = 0.732503
Epoch 3103
Loss = 7.8950e-03, PNorm = 294.6081, GNorm = 0.0611, lr_0 = 9.9811e-04
Validation auc = 0.738791
Epoch 3104
Loss = 6.5238e-03, PNorm = 294.6451, GNorm = 0.1348, lr_0 = 9.9811e-04
Validation auc = 0.741858
Epoch 3105
Loss = 6.1014e-02, PNorm = 294.6948, GNorm = 0.1826, lr_0 = 9.9811e-04
Validation auc = 0.735824
Epoch 3106
Loss = 6.7111e-02, PNorm = 294.7619, GNorm = 2.5165, lr_0 = 9.9811e-04
Validation auc = 0.739676
Epoch 3107
Loss = 5.5814e-02, PNorm = 294.8256, GNorm = 0.9348, lr_0 = 9.9811e-04
Validation auc = 0.745465
Epoch 3108
Loss = 4.9623e-03, PNorm = 294.8882, GNorm = 0.1843, lr_0 = 9.9811e-04
Validation auc = 0.742281
Epoch 3109
Loss = 1.7381e-02, PNorm = 294.9387, GNorm = 1.8896, lr_0 = 9.9811e-04
Loss = 3.4496e-02, PNorm = 294.9714, GNorm = 0.6699, lr_0 = 9.9811e-04
Validation auc = 0.740224
Epoch 3110
Loss = 3.3656e-02, PNorm = 295.0145, GNorm = 1.1506, lr_0 = 9.9811e-04
Validation auc = 0.733980
Epoch 3111
Loss = 5.2070e-02, PNorm = 295.0739, GNorm = 0.9224, lr_0 = 9.9811e-04
Validation auc = 0.730345
Epoch 3112
Loss = 5.1979e-02, PNorm = 295.1410, GNorm = 0.1225, lr_0 = 9.9810e-04
Validation auc = 0.734365
Epoch 3113
Loss = 1.9832e-02, PNorm = 295.1970, GNorm = 0.0614, lr_0 = 9.9810e-04
Validation auc = 0.740628
Epoch 3114
Loss = 2.4131e-02, PNorm = 295.2432, GNorm = 1.2914, lr_0 = 9.9810e-04
Validation auc = 0.741781
Epoch 3115
Loss = 1.8250e-02, PNorm = 295.2871, GNorm = 0.8103, lr_0 = 9.9810e-04
Validation auc = 0.735117
Epoch 3116
Loss = 7.8295e-03, PNorm = 295.3263, GNorm = 1.4092, lr_0 = 9.9810e-04
Validation auc = 0.735345
Epoch 3117
Loss = 2.7791e-02, PNorm = 295.3603, GNorm = 1.1355, lr_0 = 9.9810e-04
Validation auc = 0.732141
Epoch 3118
Loss = 1.6069e-02, PNorm = 295.4002, GNorm = 1.9158, lr_0 = 9.9810e-04
Validation auc = 0.734272
Epoch 3119
Loss = 1.2669e-03, PNorm = 295.4435, GNorm = 0.0455, lr_0 = 9.9810e-04
Loss = 1.4265e-02, PNorm = 295.4859, GNorm = 1.3942, lr_0 = 9.9810e-04
Validation auc = 0.744801
Epoch 3120
Loss = 2.6828e-02, PNorm = 295.5270, GNorm = 1.1315, lr_0 = 9.9810e-04
Validation auc = 0.750257
Epoch 3121
Loss = 1.7899e-02, PNorm = 295.5651, GNorm = 1.2306, lr_0 = 9.9810e-04
Validation auc = 0.750724
Epoch 3122
Loss = 1.3442e-02, PNorm = 295.6011, GNorm = 0.2559, lr_0 = 9.9810e-04
Validation auc = 0.749098
Epoch 3123
Loss = 2.6018e-02, PNorm = 295.6360, GNorm = 0.0444, lr_0 = 9.9810e-04
Validation auc = 0.749387
Epoch 3124
Loss = 4.2995e-02, PNorm = 295.6719, GNorm = 0.7069, lr_0 = 9.9810e-04
Validation auc = 0.748474
Epoch 3125
Loss = 1.5231e-02, PNorm = 295.7052, GNorm = 0.3448, lr_0 = 9.9810e-04
Validation auc = 0.747825
Epoch 3126
Loss = 3.5207e-02, PNorm = 295.7413, GNorm = 0.5243, lr_0 = 9.9809e-04
Validation auc = 0.745560
Epoch 3127
Loss = 9.6513e-03, PNorm = 295.7742, GNorm = 0.8333, lr_0 = 9.9809e-04
Validation auc = 0.745758
Epoch 3128
Loss = 1.2206e-02, PNorm = 295.8001, GNorm = 0.1618, lr_0 = 9.9809e-04
Validation auc = 0.746103
Epoch 3129
Loss = 4.5426e-02, PNorm = 295.8266, GNorm = 1.9705, lr_0 = 9.9809e-04
Loss = 1.5842e-02, PNorm = 295.8779, GNorm = 0.7086, lr_0 = 9.9809e-04
Validation auc = 0.736970
Epoch 3130
Loss = 3.4813e-02, PNorm = 295.9187, GNorm = 1.0964, lr_0 = 9.9809e-04
Validation auc = 0.726739
Epoch 3131
Loss = 1.5575e-02, PNorm = 295.9598, GNorm = 0.1431, lr_0 = 9.9809e-04
Validation auc = 0.719060
Epoch 3132
Loss = 1.2026e-02, PNorm = 295.9972, GNorm = 0.0601, lr_0 = 9.9809e-04
Validation auc = 0.720913
Epoch 3133
Loss = 2.5059e-02, PNorm = 296.0267, GNorm = 1.6127, lr_0 = 9.9809e-04
Validation auc = 0.724381
Epoch 3134
Loss = 5.2735e-03, PNorm = 296.0676, GNorm = 0.0800, lr_0 = 9.9809e-04
Validation auc = 0.730326
Epoch 3135
Loss = 1.6780e-02, PNorm = 296.1087, GNorm = 0.5622, lr_0 = 9.9809e-04
Validation auc = 0.734334
Epoch 3136
Loss = 7.6534e-03, PNorm = 296.1450, GNorm = 0.9046, lr_0 = 9.9809e-04
Validation auc = 0.731919
Epoch 3137
Loss = 5.3159e-03, PNorm = 296.1768, GNorm = 0.7089, lr_0 = 9.9809e-04
Validation auc = 0.728438
Epoch 3138
Loss = 2.8928e-02, PNorm = 296.2091, GNorm = 0.9070, lr_0 = 9.9809e-04
Validation auc = 0.711679
Epoch 3139
Loss = 1.0979e-02, PNorm = 296.2443, GNorm = 0.7296, lr_0 = 9.9808e-04
Loss = 1.1198e-01, PNorm = 296.2831, GNorm = 7.2712, lr_0 = 9.9808e-04
Validation auc = 0.717716
Epoch 3140
Loss = 2.9674e-02, PNorm = 296.3484, GNorm = 3.3871, lr_0 = 9.9808e-04
Validation auc = 0.722789
Epoch 3141
Loss = 2.9937e-02, PNorm = 296.4452, GNorm = 0.7532, lr_0 = 9.9808e-04
Validation auc = 0.719015
Epoch 3142
Loss = 5.0555e-02, PNorm = 296.5210, GNorm = 1.6683, lr_0 = 9.9808e-04
Validation auc = 0.721260
Epoch 3143
Loss = 2.6090e-02, PNorm = 296.5797, GNorm = 1.0836, lr_0 = 9.9808e-04
Validation auc = 0.727337
Epoch 3144
Loss = 2.0581e-02, PNorm = 296.6241, GNorm = 0.2322, lr_0 = 9.9808e-04
Validation auc = 0.730580
Epoch 3145
Loss = 1.2539e-02, PNorm = 296.6622, GNorm = 1.3599, lr_0 = 9.9808e-04
Validation auc = 0.727395
Epoch 3146
Loss = 2.0811e-02, PNorm = 296.6957, GNorm = 0.0817, lr_0 = 9.9808e-04
Validation auc = 0.727697
Epoch 3147
Loss = 2.1484e-02, PNorm = 296.7373, GNorm = 2.3952, lr_0 = 9.9808e-04
Validation auc = 0.733249
Epoch 3148
Loss = 1.0423e-02, PNorm = 296.7942, GNorm = 0.0801, lr_0 = 9.9808e-04
Validation auc = 0.720137
Epoch 3149
Loss = 6.0791e-03, PNorm = 296.8550, GNorm = 0.2039, lr_0 = 9.9808e-04
Loss = 1.6583e-02, PNorm = 296.9046, GNorm = 0.1731, lr_0 = 9.9808e-04
Validation auc = 0.711924
Epoch 3150
Loss = 3.8028e-02, PNorm = 296.9481, GNorm = 1.1627, lr_0 = 9.9808e-04
Validation auc = 0.712795
Epoch 3151
Loss = 1.6565e-02, PNorm = 297.0033, GNorm = 0.1647, lr_0 = 9.9808e-04
Validation auc = 0.714954
Epoch 3152
Loss = 2.6377e-02, PNorm = 297.0521, GNorm = 0.1480, lr_0 = 9.9807e-04
Validation auc = 0.716129
Epoch 3153
Loss = 3.2177e-02, PNorm = 297.0903, GNorm = 0.9753, lr_0 = 9.9807e-04
Validation auc = 0.713045
Epoch 3154
Loss = 2.2158e-02, PNorm = 297.1268, GNorm = 1.7374, lr_0 = 9.9807e-04
Validation auc = 0.710808
Epoch 3155
Loss = 1.7390e-02, PNorm = 297.1741, GNorm = 0.1424, lr_0 = 9.9807e-04
Validation auc = 0.708396
Epoch 3156
Loss = 1.2582e-02, PNorm = 297.2137, GNorm = 1.5795, lr_0 = 9.9807e-04
Validation auc = 0.713791
Epoch 3157
Loss = 4.9936e-02, PNorm = 297.2494, GNorm = 1.0688, lr_0 = 9.9807e-04
Validation auc = 0.714310
Epoch 3158
Loss = 8.7361e-03, PNorm = 297.2848, GNorm = 0.0973, lr_0 = 9.9807e-04
Validation auc = 0.711145
Epoch 3159
Loss = 1.7761e-03, PNorm = 297.3169, GNorm = 0.1615, lr_0 = 9.9807e-04
Loss = 3.2480e-02, PNorm = 297.3545, GNorm = 1.0875, lr_0 = 9.9807e-04
Validation auc = 0.710965
Epoch 3160
Loss = 1.1353e-02, PNorm = 297.3919, GNorm = 0.0614, lr_0 = 9.9807e-04
Validation auc = 0.712626
Epoch 3161
Loss = 9.7415e-03, PNorm = 297.4228, GNorm = 1.5877, lr_0 = 9.9807e-04
Validation auc = 0.716614
Epoch 3162
Loss = 2.8356e-02, PNorm = 297.4517, GNorm = 0.0832, lr_0 = 9.9807e-04
Validation auc = 0.714310
Epoch 3163
Loss = 8.4562e-03, PNorm = 297.4828, GNorm = 0.7935, lr_0 = 9.9807e-04
Validation auc = 0.713249
Epoch 3164
Loss = 2.6856e-02, PNorm = 297.5201, GNorm = 1.3194, lr_0 = 9.9807e-04
Validation auc = 0.711202
Epoch 3165
Loss = 2.3264e-02, PNorm = 297.5672, GNorm = 0.8920, lr_0 = 9.9807e-04
Validation auc = 0.711928
Epoch 3166
Loss = 3.7736e-02, PNorm = 297.6170, GNorm = 0.0309, lr_0 = 9.9806e-04
Validation auc = 0.690619
Epoch 3167
Loss = 1.8377e-02, PNorm = 297.6768, GNorm = 0.7614, lr_0 = 9.9806e-04
Validation auc = 0.673011
Epoch 3168
Loss = 6.2167e-02, PNorm = 297.7404, GNorm = 0.9462, lr_0 = 9.9806e-04
Validation auc = 0.668503
Epoch 3169
Loss = 1.1219e-02, PNorm = 297.7980, GNorm = 0.4225, lr_0 = 9.9806e-04
Loss = 2.4044e-02, PNorm = 297.8646, GNorm = 1.1854, lr_0 = 9.9806e-04
Validation auc = 0.678630
Epoch 3170
Loss = 4.2785e-02, PNorm = 297.9301, GNorm = 0.5206, lr_0 = 9.9806e-04
Validation auc = 0.692789
Epoch 3171
Loss = 5.2679e-02, PNorm = 297.9962, GNorm = 2.4046, lr_0 = 9.9806e-04
Validation auc = 0.695560
Epoch 3172
Loss = 3.2331e-02, PNorm = 298.0830, GNorm = 0.7011, lr_0 = 9.9806e-04
Validation auc = 0.692996
Epoch 3173
Loss = 2.6853e-02, PNorm = 298.1558, GNorm = 0.2212, lr_0 = 9.9806e-04
Validation auc = 0.693080
Epoch 3174
Loss = 1.8043e-02, PNorm = 298.2059, GNorm = 0.0914, lr_0 = 9.9806e-04
Validation auc = 0.692905
Epoch 3175
Loss = 3.9938e-02, PNorm = 298.2457, GNorm = 1.0024, lr_0 = 9.9806e-04
Validation auc = 0.700662
Epoch 3176
Loss = 1.5660e-02, PNorm = 298.2984, GNorm = 0.5999, lr_0 = 9.9806e-04
Validation auc = 0.701311
Epoch 3177
Loss = 8.3542e-02, PNorm = 298.3561, GNorm = 2.6329, lr_0 = 9.9806e-04
Validation auc = 0.707414
Epoch 3178
Loss = 2.4358e-02, PNorm = 298.4303, GNorm = 2.2621, lr_0 = 9.9806e-04
Validation auc = 0.716702
Epoch 3179
Loss = 1.2300e-01, PNorm = 298.5044, GNorm = 4.3609, lr_0 = 9.9805e-04
Loss = 2.9883e-02, PNorm = 298.5769, GNorm = 1.2756, lr_0 = 9.9805e-04
Validation auc = 0.711562
Epoch 3180
Loss = 2.1781e-02, PNorm = 298.6458, GNorm = 0.7389, lr_0 = 9.9805e-04
Validation auc = 0.715613
Epoch 3181
Loss = 1.5056e-02, PNorm = 298.6999, GNorm = 0.4109, lr_0 = 9.9805e-04
Validation auc = 0.716128
Epoch 3182
Loss = 2.4861e-02, PNorm = 298.7503, GNorm = 0.0874, lr_0 = 9.9805e-04
Validation auc = 0.714699
Epoch 3183
Loss = 1.0058e-02, PNorm = 298.7927, GNorm = 0.0754, lr_0 = 9.9805e-04
Validation auc = 0.709060
Epoch 3184
Loss = 1.0548e-02, PNorm = 298.8282, GNorm = 1.1480, lr_0 = 9.9805e-04
Validation auc = 0.706755
Epoch 3185
Loss = 4.2362e-02, PNorm = 298.8693, GNorm = 0.0301, lr_0 = 9.9805e-04
Validation auc = 0.704613
Epoch 3186
Loss = 9.9763e-03, PNorm = 298.9113, GNorm = 0.2152, lr_0 = 9.9805e-04
Validation auc = 0.705701
Epoch 3187
Loss = 3.0172e-02, PNorm = 298.9439, GNorm = 0.0221, lr_0 = 9.9805e-04
Validation auc = 0.708325
Epoch 3188
Loss = 5.0506e-03, PNorm = 298.9800, GNorm = 0.1983, lr_0 = 9.9805e-04
Validation auc = 0.712341
Epoch 3189
Loss = 2.3741e-03, PNorm = 299.0150, GNorm = 0.0774, lr_0 = 9.9805e-04
Loss = 4.6055e-02, PNorm = 299.0553, GNorm = 1.3996, lr_0 = 9.9805e-04
Validation auc = 0.694807
Epoch 3190
Loss = 6.0544e-02, PNorm = 299.1300, GNorm = 0.2465, lr_0 = 9.9805e-04
Validation auc = 0.673814
Epoch 3191
Loss = 5.1857e-02, PNorm = 299.1971, GNorm = 1.0463, lr_0 = 9.9805e-04
Validation auc = 0.682115
Epoch 3192
Loss = 7.8148e-02, PNorm = 299.2650, GNorm = 1.2803, lr_0 = 9.9804e-04
Validation auc = 0.684758
Epoch 3193
Loss = 2.5137e-02, PNorm = 299.3344, GNorm = 0.8927, lr_0 = 9.9804e-04
Validation auc = 0.687538
Epoch 3194
Loss = 5.0410e-02, PNorm = 299.3853, GNorm = 0.0806, lr_0 = 9.9804e-04
Validation auc = 0.694436
Epoch 3195
Loss = 2.3713e-02, PNorm = 299.4433, GNorm = 0.3448, lr_0 = 9.9804e-04
Validation auc = 0.694467
Epoch 3196
Loss = 3.9543e-02, PNorm = 299.5057, GNorm = 1.3007, lr_0 = 9.9804e-04
Validation auc = 0.690114
Epoch 3197
Loss = 4.7247e-02, PNorm = 299.5454, GNorm = 0.1952, lr_0 = 9.9804e-04
Validation auc = 0.691523
Epoch 3198
Loss = 8.6661e-03, PNorm = 299.5723, GNorm = 0.4827, lr_0 = 9.9804e-04
Validation auc = 0.693118
Epoch 3199
Loss = 2.3277e-03, PNorm = 299.6045, GNorm = 0.0710, lr_0 = 9.9804e-04
Loss = 2.1397e-02, PNorm = 299.6445, GNorm = 0.9107, lr_0 = 9.9804e-04
Validation auc = 0.691445
Epoch 3200
Loss = 2.2194e-02, PNorm = 299.6908, GNorm = 0.4014, lr_0 = 9.9804e-04
Validation auc = 0.680552
Epoch 3201
Loss = 1.5678e-02, PNorm = 299.7300, GNorm = 0.0667, lr_0 = 9.9804e-04
Validation auc = 0.683827
Epoch 3202
Loss = 2.2794e-02, PNorm = 299.7538, GNorm = 0.5407, lr_0 = 9.9804e-04
Validation auc = 0.686534
Epoch 3203
Loss = 2.1964e-02, PNorm = 299.7868, GNorm = 0.6186, lr_0 = 9.9804e-04
Validation auc = 0.690420
Epoch 3204
Loss = 6.0125e-03, PNorm = 299.8189, GNorm = 0.3600, lr_0 = 9.9804e-04
Validation auc = 0.690649
Epoch 3205
Loss = 6.9564e-02, PNorm = 299.8584, GNorm = 0.6669, lr_0 = 9.9803e-04
Validation auc = 0.693660
Epoch 3206
Loss = 2.4503e-02, PNorm = 299.9330, GNorm = 0.5773, lr_0 = 9.9803e-04
Validation auc = 0.702955
Epoch 3207
Loss = 1.6641e-02, PNorm = 300.0004, GNorm = 1.4361, lr_0 = 9.9803e-04
Validation auc = 0.698033
Epoch 3208
Loss = 7.7633e-03, PNorm = 300.0719, GNorm = 0.2190, lr_0 = 9.9803e-04
Validation auc = 0.692038
Epoch 3209
Loss = 1.0188e-02, PNorm = 300.1311, GNorm = 0.4962, lr_0 = 9.9803e-04
Loss = 1.1127e-02, PNorm = 300.1801, GNorm = 0.9888, lr_0 = 9.9803e-04
Validation auc = 0.688774
Epoch 3210
Loss = 1.2344e-02, PNorm = 300.2165, GNorm = 0.1439, lr_0 = 9.9803e-04
Validation auc = 0.687212
Epoch 3211
Loss = 4.1760e-02, PNorm = 300.2761, GNorm = 0.0216, lr_0 = 9.9803e-04
Validation auc = 0.691665
Epoch 3212
Loss = 3.2612e-02, PNorm = 300.3443, GNorm = 0.4723, lr_0 = 9.9803e-04
Validation auc = 0.692779
Epoch 3213
Loss = 2.1207e-02, PNorm = 300.4195, GNorm = 0.0653, lr_0 = 9.9803e-04
Validation auc = 0.685548
Epoch 3214
Loss = 1.9451e-02, PNorm = 300.4834, GNorm = 0.7323, lr_0 = 9.9803e-04
Validation auc = 0.683001
Epoch 3215
Loss = 2.8597e-02, PNorm = 300.5358, GNorm = 0.3724, lr_0 = 9.9803e-04
Validation auc = 0.684254
Epoch 3216
Loss = 4.1882e-02, PNorm = 300.6018, GNorm = 2.3047, lr_0 = 9.9803e-04
Validation auc = 0.682034
Epoch 3217
Loss = 4.8794e-02, PNorm = 300.6824, GNorm = 0.4867, lr_0 = 9.9803e-04
Validation auc = 0.688923
Epoch 3218
Loss = 4.5845e-02, PNorm = 300.7484, GNorm = 0.0180, lr_0 = 9.9803e-04
Validation auc = 0.683712
Epoch 3219
Loss = 1.4600e-02, PNorm = 300.8067, GNorm = 0.7135, lr_0 = 9.9802e-04
Loss = 2.0476e-02, PNorm = 300.8639, GNorm = 0.0408, lr_0 = 9.9802e-04
Validation auc = 0.685869
Epoch 3220
Loss = 4.5001e-02, PNorm = 300.9255, GNorm = 1.5078, lr_0 = 9.9802e-04
Validation auc = 0.685311
Epoch 3221
Loss = 3.2150e-02, PNorm = 300.9855, GNorm = 0.2351, lr_0 = 9.9802e-04
Validation auc = 0.684962
Epoch 3222
Loss = 4.4316e-02, PNorm = 301.0510, GNorm = 1.8096, lr_0 = 9.9802e-04
Validation auc = 0.699633
Epoch 3223
Loss = 2.2091e-02, PNorm = 301.1161, GNorm = 0.5024, lr_0 = 9.9802e-04
Validation auc = 0.703429
Epoch 3224
Loss = 4.7666e-02, PNorm = 301.1909, GNorm = 1.2499, lr_0 = 9.9802e-04
Validation auc = 0.698902
Epoch 3225
Loss = 1.8422e-02, PNorm = 301.2515, GNorm = 0.0568, lr_0 = 9.9802e-04
Validation auc = 0.696801
Epoch 3226
Loss = 7.1355e-02, PNorm = 301.2984, GNorm = 1.1708, lr_0 = 9.9802e-04
Validation auc = 0.707203
Epoch 3227
Loss = 1.0632e-02, PNorm = 301.3509, GNorm = 0.3074, lr_0 = 9.9802e-04
Validation auc = 0.703493
Epoch 3228
Loss = 1.3760e-01, PNorm = 301.3948, GNorm = 1.4507, lr_0 = 9.9802e-04
Validation auc = 0.698181
Epoch 3229
Loss = 9.8662e-02, PNorm = 301.4354, GNorm = 1.3242, lr_0 = 9.9802e-04
Loss = 3.1263e-02, PNorm = 301.4880, GNorm = 0.3482, lr_0 = 9.9802e-04
Validation auc = 0.692696
Epoch 3230
Loss = 5.2641e-02, PNorm = 301.5738, GNorm = 1.9615, lr_0 = 9.9802e-04
Validation auc = 0.691313
Epoch 3231
Loss = 2.2827e-02, PNorm = 301.6552, GNorm = 0.3973, lr_0 = 9.9801e-04
Validation auc = 0.694686
Epoch 3232
Loss = 4.1223e-02, PNorm = 301.7268, GNorm = 0.6853, lr_0 = 9.9801e-04
Validation auc = 0.688043
Epoch 3233
Loss = 3.1613e-02, PNorm = 301.7997, GNorm = 2.2926, lr_0 = 9.9801e-04
Validation auc = 0.693027
Epoch 3234
Loss = 2.5607e-02, PNorm = 301.8740, GNorm = 0.2806, lr_0 = 9.9801e-04
Validation auc = 0.694222
Epoch 3235
Loss = 1.0543e-02, PNorm = 301.9362, GNorm = 0.3276, lr_0 = 9.9801e-04
Validation auc = 0.698578
Epoch 3236
Loss = 1.0234e-02, PNorm = 301.9911, GNorm = 0.0556, lr_0 = 9.9801e-04
Validation auc = 0.704834
Epoch 3237
Loss = 1.0469e-02, PNorm = 302.0342, GNorm = 0.0488, lr_0 = 9.9801e-04
Validation auc = 0.710047
Epoch 3238
Loss = 1.5259e-02, PNorm = 302.0711, GNorm = 0.8545, lr_0 = 9.9801e-04
Validation auc = 0.714318
Epoch 3239
Loss = 2.4469e-03, PNorm = 302.1075, GNorm = 0.0854, lr_0 = 9.9801e-04
Loss = 1.0128e-02, PNorm = 302.1392, GNorm = 0.0646, lr_0 = 9.9801e-04
Validation auc = 0.711231
Epoch 3240
Loss = 1.8028e-02, PNorm = 302.1682, GNorm = 1.7192, lr_0 = 9.9801e-04
Validation auc = 0.712963
Epoch 3241
Loss = 1.2758e-02, PNorm = 302.2054, GNorm = 0.0387, lr_0 = 9.9801e-04
Validation auc = 0.714448
Epoch 3242
Loss = 5.8973e-03, PNorm = 302.2383, GNorm = 0.2968, lr_0 = 9.9801e-04
Validation auc = 0.714197
Epoch 3243
Loss = 1.0870e-02, PNorm = 302.2623, GNorm = 0.5572, lr_0 = 9.9801e-04
Validation auc = 0.719572
Epoch 3244
Loss = 2.2411e-02, PNorm = 302.2930, GNorm = 0.1111, lr_0 = 9.9801e-04
Validation auc = 0.734084
Epoch 3245
Loss = 4.5157e-03, PNorm = 302.3247, GNorm = 0.0407, lr_0 = 9.9800e-04
Validation auc = 0.739927
Epoch 3246
Loss = 6.9560e-03, PNorm = 302.3535, GNorm = 0.2192, lr_0 = 9.9800e-04
Validation auc = 0.729206
Epoch 3247
Loss = 8.6877e-02, PNorm = 302.3913, GNorm = 0.0079, lr_0 = 9.9800e-04
Validation auc = 0.721024
Epoch 3248
Loss = 6.8755e-03, PNorm = 302.4391, GNorm = 0.0578, lr_0 = 9.9800e-04
Validation auc = 0.722280
Epoch 3249
Loss = 1.8977e-02, PNorm = 302.4906, GNorm = 0.8033, lr_0 = 9.9800e-04
Loss = 3.0029e-02, PNorm = 302.5375, GNorm = 0.7993, lr_0 = 9.9800e-04
Validation auc = 0.723720
Epoch 3250
Loss = 3.9557e-02, PNorm = 302.5821, GNorm = 0.1355, lr_0 = 9.9800e-04
Validation auc = 0.719895
Epoch 3251
Loss = 3.5458e-02, PNorm = 302.6243, GNorm = 0.3344, lr_0 = 9.9800e-04
Validation auc = 0.719484
Epoch 3252
Loss = 3.4896e-02, PNorm = 302.6841, GNorm = 0.0545, lr_0 = 9.9800e-04
Validation auc = 0.715864
Epoch 3253
Loss = 3.8172e-02, PNorm = 302.7535, GNorm = 1.5353, lr_0 = 9.9800e-04
Validation auc = 0.713229
Epoch 3254
Loss = 2.1847e-02, PNorm = 302.8108, GNorm = 1.0292, lr_0 = 9.9800e-04
Validation auc = 0.706475
Epoch 3255
Loss = 6.0569e-02, PNorm = 302.8726, GNorm = 1.8901, lr_0 = 9.9800e-04
Validation auc = 0.702854
Epoch 3256
Loss = 8.7307e-02, PNorm = 302.9477, GNorm = 0.6679, lr_0 = 9.9800e-04
Validation auc = 0.696515
Epoch 3257
Loss = 3.8156e-02, PNorm = 303.0067, GNorm = 1.5998, lr_0 = 9.9800e-04
Validation auc = 0.701105
Epoch 3258
Loss = 5.8253e-03, PNorm = 303.0554, GNorm = 0.5330, lr_0 = 9.9799e-04
Validation auc = 0.709475
Epoch 3259
Loss = 7.0583e-02, PNorm = 303.0987, GNorm = 0.8496, lr_0 = 9.9799e-04
Loss = 7.5088e-02, PNorm = 303.1454, GNorm = 0.4581, lr_0 = 9.9799e-04
Validation auc = 0.710328
Epoch 3260
Loss = 2.8873e-02, PNorm = 303.2076, GNorm = 0.1755, lr_0 = 9.9799e-04
Validation auc = 0.700333
Epoch 3261
Loss = 1.0919e-02, PNorm = 303.2584, GNorm = 1.0513, lr_0 = 9.9799e-04
Validation auc = 0.695446
Epoch 3262
Loss = 1.2186e-02, PNorm = 303.3017, GNorm = 0.3066, lr_0 = 9.9799e-04
Validation auc = 0.691689
Epoch 3263
Loss = 6.9152e-02, PNorm = 303.3449, GNorm = 0.6378, lr_0 = 9.9799e-04
Validation auc = 0.692145
Epoch 3264
Loss = 2.5963e-02, PNorm = 303.3897, GNorm = 0.8337, lr_0 = 9.9799e-04
Validation auc = 0.703321
Epoch 3265
Loss = 1.8424e-02, PNorm = 303.4301, GNorm = 0.0513, lr_0 = 9.9799e-04
Validation auc = 0.704396
Epoch 3266
Loss = 1.4166e-02, PNorm = 303.4659, GNorm = 0.5235, lr_0 = 9.9799e-04
Validation auc = 0.704925
Epoch 3267
Loss = 7.4819e-02, PNorm = 303.4949, GNorm = 1.7925, lr_0 = 9.9799e-04
Validation auc = 0.708730
Epoch 3268
Loss = 7.6884e-02, PNorm = 303.5161, GNorm = 1.2487, lr_0 = 9.9799e-04
Validation auc = 0.706730
Epoch 3269
Loss = 9.4410e-02, PNorm = 303.5565, GNorm = 1.6859, lr_0 = 9.9799e-04
Loss = 1.3310e-02, PNorm = 303.6120, GNorm = 0.1532, lr_0 = 9.9799e-04
Validation auc = 0.705381
Epoch 3270
Loss = 2.9690e-02, PNorm = 303.6569, GNorm = 0.0400, lr_0 = 9.9799e-04
Validation auc = 0.702216
Epoch 3271
Loss = 9.6796e-03, PNorm = 303.6963, GNorm = 0.2664, lr_0 = 9.9798e-04
Validation auc = 0.700746
Epoch 3272
Loss = 2.5794e-02, PNorm = 303.7251, GNorm = 0.0300, lr_0 = 9.9798e-04
Validation auc = 0.704797
Epoch 3273
Loss = 1.4525e-02, PNorm = 303.7693, GNorm = 0.8681, lr_0 = 9.9798e-04
Validation auc = 0.696550
Epoch 3274
Loss = 5.5557e-02, PNorm = 303.8245, GNorm = 1.4054, lr_0 = 9.9798e-04
Validation auc = 0.686643
Epoch 3275
Loss = 3.5637e-02, PNorm = 303.8892, GNorm = 0.6913, lr_0 = 9.9798e-04
Validation auc = 0.677083
Epoch 3276
Loss = 2.9960e-02, PNorm = 303.9523, GNorm = 0.1395, lr_0 = 9.9798e-04
Validation auc = 0.694319
Epoch 3277
Loss = 5.5171e-03, PNorm = 304.0103, GNorm = 0.4336, lr_0 = 9.9798e-04
Validation auc = 0.696682
Epoch 3278
Loss = 1.2740e-02, PNorm = 304.0632, GNorm = 0.9143, lr_0 = 9.9798e-04
Validation auc = 0.698041
Epoch 3279
Loss = 1.5703e-03, PNorm = 304.1347, GNorm = 0.0467, lr_0 = 9.9798e-04
Loss = 2.3559e-02, PNorm = 304.2033, GNorm = 0.0936, lr_0 = 9.9798e-04
Validation auc = 0.694885
Epoch 3280
Loss = 3.4522e-02, PNorm = 304.2528, GNorm = 1.7796, lr_0 = 9.9798e-04
Validation auc = 0.702176
Epoch 3281
Loss = 1.9657e-02, PNorm = 304.3034, GNorm = 0.2277, lr_0 = 9.9798e-04
Validation auc = 0.708116
Epoch 3282
Loss = 2.1419e-02, PNorm = 304.3427, GNorm = 0.3575, lr_0 = 9.9798e-04
Validation auc = 0.698626
Epoch 3283
Loss = 3.2106e-02, PNorm = 304.3766, GNorm = 0.0947, lr_0 = 9.9798e-04
Validation auc = 0.698704
Epoch 3284
Loss = 2.6994e-02, PNorm = 304.4170, GNorm = 0.2222, lr_0 = 9.9798e-04
Validation auc = 0.695493
Epoch 3285
Loss = 5.1895e-02, PNorm = 304.4681, GNorm = 0.3728, lr_0 = 9.9797e-04
Validation auc = 0.691659
Epoch 3286
Loss = 1.0371e-02, PNorm = 304.5185, GNorm = 0.1865, lr_0 = 9.9797e-04
Validation auc = 0.688481
Epoch 3287
Loss = 2.7648e-02, PNorm = 304.5689, GNorm = 0.1543, lr_0 = 9.9797e-04
Validation auc = 0.703597
Epoch 3288
Loss = 3.2568e-02, PNorm = 304.6199, GNorm = 0.1499, lr_0 = 9.9797e-04
Validation auc = 0.703311
Epoch 3289
Loss = 9.1913e-03, PNorm = 304.6546, GNorm = 0.4650, lr_0 = 9.9797e-04
Loss = 1.7445e-02, PNorm = 304.6808, GNorm = 0.4644, lr_0 = 9.9797e-04
Validation auc = 0.695863
Epoch 3290
Loss = 5.3409e-02, PNorm = 304.7196, GNorm = 0.5856, lr_0 = 9.9797e-04
Validation auc = 0.690113
Epoch 3291
Loss = 2.5069e-02, PNorm = 304.7740, GNorm = 0.3693, lr_0 = 9.9797e-04
Validation auc = 0.694654
Epoch 3292
Loss = 1.7770e-02, PNorm = 304.8140, GNorm = 0.9344, lr_0 = 9.9797e-04
Validation auc = 0.701357
Epoch 3293
Loss = 2.4690e-02, PNorm = 304.8476, GNorm = 2.6202, lr_0 = 9.9797e-04
Validation auc = 0.701295
Epoch 3294
Loss = 2.6745e-02, PNorm = 304.9011, GNorm = 0.9530, lr_0 = 9.9797e-04
Validation auc = 0.704262
Epoch 3295
Loss = 1.3633e-02, PNorm = 304.9572, GNorm = 1.4369, lr_0 = 9.9797e-04
Validation auc = 0.702441
Epoch 3296
Loss = 1.2014e-02, PNorm = 305.0017, GNorm = 0.0901, lr_0 = 9.9797e-04
Validation auc = 0.692522
Epoch 3297
Loss = 1.1483e-02, PNorm = 305.0485, GNorm = 0.3075, lr_0 = 9.9797e-04
Validation auc = 0.686791
Epoch 3298
Loss = 4.3181e-02, PNorm = 305.0913, GNorm = 1.8208, lr_0 = 9.9796e-04
Validation auc = 0.697323
Epoch 3299
Loss = 1.8208e-02, PNorm = 305.1506, GNorm = 0.4646, lr_0 = 9.9796e-04
Loss = 3.3620e-02, PNorm = 305.2204, GNorm = 0.1681, lr_0 = 9.9796e-04
Validation auc = 0.704936
Epoch 3300
Loss = 2.2435e-02, PNorm = 305.2758, GNorm = 0.0802, lr_0 = 9.9796e-04
Validation auc = 0.707152
Epoch 3301
Loss = 1.3863e-02, PNorm = 305.3131, GNorm = 0.2967, lr_0 = 9.9796e-04
Validation auc = 0.705398
Epoch 3302
Loss = 1.6102e-02, PNorm = 305.3409, GNorm = 1.4463, lr_0 = 9.9796e-04
Validation auc = 0.706559
Epoch 3303
Loss = 4.4858e-02, PNorm = 305.3715, GNorm = 0.0461, lr_0 = 9.9796e-04
Validation auc = 0.708194
Epoch 3304
Loss = 3.0492e-02, PNorm = 305.4205, GNorm = 0.1759, lr_0 = 9.9796e-04
Validation auc = 0.708394
Epoch 3305
Loss = 2.3782e-02, PNorm = 305.4732, GNorm = 0.0174, lr_0 = 9.9796e-04
Validation auc = 0.702315
Epoch 3306
Loss = 3.2201e-02, PNorm = 305.5206, GNorm = 1.4636, lr_0 = 9.9796e-04
Validation auc = 0.700294
Epoch 3307
Loss = 1.6882e-02, PNorm = 305.5565, GNorm = 0.5306, lr_0 = 9.9796e-04
Validation auc = 0.707032
Epoch 3308
Loss = 5.1107e-03, PNorm = 305.5922, GNorm = 0.2837, lr_0 = 9.9796e-04
Validation auc = 0.710081
Epoch 3309
Loss = 7.5321e-02, PNorm = 305.6286, GNorm = 1.7939, lr_0 = 9.9796e-04
Loss = 3.2369e-02, PNorm = 305.6806, GNorm = 0.0684, lr_0 = 9.9796e-04
Validation auc = 0.714132
Epoch 3310
Loss = 1.4185e-02, PNorm = 305.7448, GNorm = 0.5487, lr_0 = 9.9796e-04
Validation auc = 0.714443
Epoch 3311
Loss = 4.1146e-02, PNorm = 305.7930, GNorm = 2.0706, lr_0 = 9.9795e-04
Validation auc = 0.714654
Epoch 3312
Loss = 2.6600e-02, PNorm = 305.8461, GNorm = 1.9406, lr_0 = 9.9795e-04
Validation auc = 0.721153
Epoch 3313
Loss = 2.4892e-02, PNorm = 305.9084, GNorm = 0.4088, lr_0 = 9.9795e-04
Validation auc = 0.724121
Epoch 3314
Loss = 2.5758e-02, PNorm = 305.9601, GNorm = 0.2635, lr_0 = 9.9795e-04
Validation auc = 0.734692
Epoch 3315
Loss = 2.4133e-02, PNorm = 306.0004, GNorm = 0.2519, lr_0 = 9.9795e-04
Validation auc = 0.738076
Epoch 3316
Loss = 6.2410e-02, PNorm = 306.0297, GNorm = 1.6229, lr_0 = 9.9795e-04
Validation auc = 0.743532
Epoch 3317
Loss = 1.5646e-02, PNorm = 306.0654, GNorm = 1.4831, lr_0 = 9.9795e-04
Validation auc = 0.743391
Epoch 3318
Loss = 7.4271e-03, PNorm = 306.1024, GNorm = 0.0502, lr_0 = 9.9795e-04
Validation auc = 0.738970
Epoch 3319
Loss = 2.9031e-02, PNorm = 306.1367, GNorm = 1.3721, lr_0 = 9.9795e-04
Loss = 3.6241e-02, PNorm = 306.1868, GNorm = 0.4307, lr_0 = 9.9795e-04
Validation auc = 0.734900
Epoch 3320
Loss = 3.0413e-02, PNorm = 306.2366, GNorm = 1.3808, lr_0 = 9.9795e-04
Validation auc = 0.733279
Epoch 3321
Loss = 2.3067e-02, PNorm = 306.2815, GNorm = 0.4507, lr_0 = 9.9795e-04
Validation auc = 0.735920
Epoch 3322
Loss = 3.2501e-02, PNorm = 306.3276, GNorm = 0.3110, lr_0 = 9.9795e-04
Validation auc = 0.738936
Epoch 3323
Loss = 4.0210e-02, PNorm = 306.3738, GNorm = 0.0811, lr_0 = 9.9795e-04
Validation auc = 0.746746
Epoch 3324
Loss = 1.0342e-02, PNorm = 306.4242, GNorm = 0.1142, lr_0 = 9.9794e-04
Validation auc = 0.748427
Epoch 3325
Loss = 1.8744e-02, PNorm = 306.4644, GNorm = 0.1730, lr_0 = 9.9794e-04
Validation auc = 0.749444
Epoch 3326
Loss = 1.7026e-02, PNorm = 306.5093, GNorm = 0.1543, lr_0 = 9.9794e-04
Validation auc = 0.745837
Epoch 3327
Loss = 1.7692e-02, PNorm = 306.5509, GNorm = 0.1837, lr_0 = 9.9794e-04
Validation auc = 0.728888
Epoch 3328
Loss = 1.7007e-02, PNorm = 306.5989, GNorm = 0.9360, lr_0 = 9.9794e-04
Validation auc = 0.727963
Epoch 3329
Loss = 2.3934e-03, PNorm = 306.6454, GNorm = 0.0749, lr_0 = 9.9794e-04
Loss = 2.0671e-02, PNorm = 306.6803, GNorm = 0.5602, lr_0 = 9.9794e-04
Validation auc = 0.733588
Epoch 3330
Loss = 2.8857e-02, PNorm = 306.7191, GNorm = 0.4293, lr_0 = 9.9794e-04
Validation auc = 0.737804
Epoch 3331
Loss = 3.8370e-02, PNorm = 306.7571, GNorm = 0.0805, lr_0 = 9.9794e-04
Validation auc = 0.738755
Epoch 3332
Loss = 2.5048e-02, PNorm = 306.7998, GNorm = 0.2306, lr_0 = 9.9794e-04
Validation auc = 0.733530
Epoch 3333
Loss = 2.6699e-02, PNorm = 306.8480, GNorm = 0.0706, lr_0 = 9.9794e-04
Validation auc = 0.735666
Epoch 3334
Loss = 8.1772e-03, PNorm = 306.8882, GNorm = 0.1864, lr_0 = 9.9794e-04
Validation auc = 0.737144
Epoch 3335
Loss = 7.7147e-02, PNorm = 306.9184, GNorm = 1.2285, lr_0 = 9.9794e-04
Validation auc = 0.745320
Epoch 3336
Loss = 3.2665e-02, PNorm = 306.9603, GNorm = 1.2713, lr_0 = 9.9794e-04
Validation auc = 0.751085
Epoch 3337
Loss = 1.6134e-02, PNorm = 307.0117, GNorm = 0.7303, lr_0 = 9.9794e-04
Validation auc = 0.745561
Epoch 3338
Loss = 3.1857e-02, PNorm = 307.0657, GNorm = 0.1391, lr_0 = 9.9793e-04
Validation auc = 0.741174
Epoch 3339
Loss = 3.1795e-03, PNorm = 307.1154, GNorm = 0.1637, lr_0 = 9.9793e-04
Loss = 4.0042e-02, PNorm = 307.1474, GNorm = 0.8023, lr_0 = 9.9793e-04
Validation auc = 0.738704
Epoch 3340
Loss = 3.2506e-02, PNorm = 307.1836, GNorm = 1.1958, lr_0 = 9.9793e-04
Validation auc = 0.741765
Epoch 3341
Loss = 3.1955e-02, PNorm = 307.2223, GNorm = 0.9798, lr_0 = 9.9793e-04
Validation auc = 0.743191
Epoch 3342
Loss = 2.7647e-02, PNorm = 307.2585, GNorm = 0.1137, lr_0 = 9.9793e-04
Validation auc = 0.738513
Epoch 3343
Loss = 2.1079e-02, PNorm = 307.2932, GNorm = 1.0188, lr_0 = 9.9793e-04
Validation auc = 0.739452
Epoch 3344
Loss = 1.3186e-02, PNorm = 307.3236, GNorm = 0.0598, lr_0 = 9.9793e-04
Validation auc = 0.745744
Epoch 3345
Loss = 4.2430e-02, PNorm = 307.3549, GNorm = 1.5570, lr_0 = 9.9793e-04
Validation auc = 0.748942
Epoch 3346
Loss = 3.9813e-02, PNorm = 307.3926, GNorm = 3.9114, lr_0 = 9.9793e-04
Validation auc = 0.745854
Epoch 3347
Loss = 4.2112e-03, PNorm = 307.4320, GNorm = 0.3787, lr_0 = 9.9793e-04
Validation auc = 0.742384
Epoch 3348
Loss = 1.3929e-02, PNorm = 307.4625, GNorm = 0.2823, lr_0 = 9.9793e-04
Validation auc = 0.742063
Epoch 3349
Loss = 4.3481e-03, PNorm = 307.4950, GNorm = 0.1356, lr_0 = 9.9793e-04
Loss = 6.9323e-03, PNorm = 307.5330, GNorm = 0.0398, lr_0 = 9.9793e-04
Validation auc = 0.743214
Epoch 3350
Loss = 1.3085e-02, PNorm = 307.5586, GNorm = 0.1095, lr_0 = 9.9792e-04
Validation auc = 0.748425
Epoch 3351
Loss = 1.0420e-02, PNorm = 307.5819, GNorm = 0.0933, lr_0 = 9.9792e-04
Validation auc = 0.750748
Epoch 3352
Loss = 3.8523e-02, PNorm = 307.6101, GNorm = 0.0500, lr_0 = 9.9792e-04
Validation auc = 0.749768
Epoch 3353
Loss = 4.9432e-03, PNorm = 307.6450, GNorm = 0.3222, lr_0 = 9.9792e-04
Validation auc = 0.747524
Epoch 3354
Loss = 1.9811e-02, PNorm = 307.6711, GNorm = 1.7604, lr_0 = 9.9792e-04
Validation auc = 0.747104
Epoch 3355
Loss = 9.9783e-03, PNorm = 307.6948, GNorm = 0.0424, lr_0 = 9.9792e-04
Validation auc = 0.740945
Epoch 3356
Loss = 3.2133e-02, PNorm = 307.7438, GNorm = 0.3477, lr_0 = 9.9792e-04
Validation auc = 0.732593
Epoch 3357
Loss = 1.8964e-02, PNorm = 307.7967, GNorm = 0.7738, lr_0 = 9.9792e-04
Validation auc = 0.735885
Epoch 3358
Loss = 5.6059e-02, PNorm = 307.8459, GNorm = 2.6760, lr_0 = 9.9792e-04
Validation auc = 0.745866
Epoch 3359
Loss = 2.4981e-03, PNorm = 307.9031, GNorm = 0.1490, lr_0 = 9.9792e-04
Loss = 4.8562e-03, PNorm = 307.9519, GNorm = 0.0534, lr_0 = 9.9792e-04
Validation auc = 0.749660
Epoch 3360
Loss = 3.4848e-02, PNorm = 307.9930, GNorm = 0.2085, lr_0 = 9.9792e-04
Validation auc = 0.757013
Epoch 3361
Loss = 4.4043e-02, PNorm = 308.0344, GNorm = 0.2703, lr_0 = 9.9792e-04
Validation auc = 0.753201
Epoch 3362
Loss = 2.8653e-02, PNorm = 308.0826, GNorm = 1.4679, lr_0 = 9.9792e-04
Validation auc = 0.748250
Epoch 3363
Loss = 6.7606e-02, PNorm = 308.1503, GNorm = 1.3175, lr_0 = 9.9792e-04
Validation auc = 0.760216
Epoch 3364
Loss = 2.4719e-02, PNorm = 308.2146, GNorm = 0.2123, lr_0 = 9.9791e-04
Validation auc = 0.772365
Epoch 3365
Loss = 3.9677e-02, PNorm = 308.2594, GNorm = 0.5440, lr_0 = 9.9791e-04
Validation auc = 0.776873
Epoch 3366
Loss = 3.2504e-02, PNorm = 308.2946, GNorm = 0.1114, lr_0 = 9.9791e-04
Validation auc = 0.770295
Epoch 3367
Loss = 9.6142e-03, PNorm = 308.3246, GNorm = 0.0418, lr_0 = 9.9791e-04
Validation auc = 0.761977
Epoch 3368
Loss = 1.0227e-01, PNorm = 308.3529, GNorm = 0.1690, lr_0 = 9.9791e-04
Validation auc = 0.753637
Epoch 3369
Loss = 1.0359e-02, PNorm = 308.3834, GNorm = 0.2706, lr_0 = 9.9791e-04
Loss = 3.3443e-02, PNorm = 308.4119, GNorm = 0.1892, lr_0 = 9.9791e-04
Validation auc = 0.749838
Epoch 3370
Loss = 2.2454e-02, PNorm = 308.4382, GNorm = 0.1355, lr_0 = 9.9791e-04
Validation auc = 0.748106
Epoch 3371
Loss = 1.3946e-02, PNorm = 308.4590, GNorm = 0.1863, lr_0 = 9.9791e-04
Validation auc = 0.746624
Epoch 3372
Loss = 3.4739e-02, PNorm = 308.4764, GNorm = 0.1388, lr_0 = 9.9791e-04
Validation auc = 0.745171
Epoch 3373
Loss = 2.0732e-02, PNorm = 308.4976, GNorm = 1.4489, lr_0 = 9.9791e-04
Validation auc = 0.735521
Epoch 3374
Loss = 1.3524e-02, PNorm = 308.5219, GNorm = 0.1358, lr_0 = 9.9791e-04
Validation auc = 0.729102
Epoch 3375
Loss = 1.4000e-02, PNorm = 308.5555, GNorm = 1.2802, lr_0 = 9.9791e-04
Validation auc = 0.725378
Epoch 3376
Loss = 6.5463e-03, PNorm = 308.5968, GNorm = 0.3210, lr_0 = 9.9791e-04
Validation auc = 0.724812
Epoch 3377
Loss = 2.8623e-02, PNorm = 308.6332, GNorm = 0.5967, lr_0 = 9.9790e-04
Validation auc = 0.732627
Epoch 3378
Loss = 2.6200e-03, PNorm = 308.6670, GNorm = 0.0633, lr_0 = 9.9790e-04
Validation auc = 0.737552
Epoch 3379
Loss = 4.9940e-03, PNorm = 308.7024, GNorm = 0.2245, lr_0 = 9.9790e-04
Loss = 3.2471e-02, PNorm = 308.7359, GNorm = 0.0990, lr_0 = 9.9790e-04
Validation auc = 0.730444
Epoch 3380
Loss = 2.0117e-02, PNorm = 308.7668, GNorm = 0.2708, lr_0 = 9.9790e-04
Validation auc = 0.724515
Epoch 3381
Loss = 2.4248e-02, PNorm = 308.7921, GNorm = 1.1321, lr_0 = 9.9790e-04
Validation auc = 0.735569
Epoch 3382
Loss = 1.3777e-02, PNorm = 308.8192, GNorm = 0.1415, lr_0 = 9.9790e-04
Validation auc = 0.735590
Epoch 3383
Loss = 1.2109e-02, PNorm = 308.8422, GNorm = 0.4780, lr_0 = 9.9790e-04
Validation auc = 0.729711
Epoch 3384
Loss = 5.1305e-02, PNorm = 308.8723, GNorm = 0.7315, lr_0 = 9.9790e-04
Validation auc = 0.729335
Epoch 3385
Loss = 3.5100e-02, PNorm = 308.9167, GNorm = 0.1784, lr_0 = 9.9790e-04
Validation auc = 0.735393
Epoch 3386
Loss = 9.0844e-03, PNorm = 308.9606, GNorm = 0.4356, lr_0 = 9.9790e-04
Validation auc = 0.731711
Epoch 3387
Loss = 1.0238e-02, PNorm = 308.9994, GNorm = 0.2130, lr_0 = 9.9790e-04
Validation auc = 0.728728
Epoch 3388
Loss = 6.1896e-03, PNorm = 309.0383, GNorm = 0.4213, lr_0 = 9.9790e-04
Validation auc = 0.722895
Epoch 3389
Loss = 2.2181e-03, PNorm = 309.0737, GNorm = 0.1051, lr_0 = 9.9790e-04
Loss = 2.6096e-02, PNorm = 309.1117, GNorm = 0.5828, lr_0 = 9.9790e-04
Validation auc = 0.719547
Epoch 3390
Loss = 2.1572e-02, PNorm = 309.1487, GNorm = 0.1036, lr_0 = 9.9789e-04
Validation auc = 0.722473
Epoch 3391
Loss = 1.2140e-02, PNorm = 309.1823, GNorm = 0.3813, lr_0 = 9.9789e-04
Validation auc = 0.724276
Epoch 3392
Loss = 2.2922e-02, PNorm = 309.2147, GNorm = 0.6922, lr_0 = 9.9789e-04
Validation auc = 0.717641
Epoch 3393
Loss = 3.7320e-02, PNorm = 309.2672, GNorm = 1.0769, lr_0 = 9.9789e-04
Validation auc = 0.731848
Epoch 3394
Loss = 2.8987e-02, PNorm = 309.3326, GNorm = 0.1042, lr_0 = 9.9789e-04
Validation auc = 0.745437
Epoch 3395
Loss = 2.2464e-02, PNorm = 309.3854, GNorm = 2.1948, lr_0 = 9.9789e-04
Validation auc = 0.741324
Epoch 3396
Loss = 6.6632e-02, PNorm = 309.4441, GNorm = 1.0056, lr_0 = 9.9789e-04
Validation auc = 0.735887
Epoch 3397
Loss = 7.2961e-02, PNorm = 309.5163, GNorm = 0.4773, lr_0 = 9.9789e-04
Validation auc = 0.731259
Epoch 3398
Loss = 3.0705e-02, PNorm = 309.5888, GNorm = 1.4790, lr_0 = 9.9789e-04
Validation auc = 0.727443
Epoch 3399
Loss = 6.2841e-02, PNorm = 309.6420, GNorm = 1.3950, lr_0 = 9.9789e-04
Loss = 1.0994e-02, PNorm = 309.6762, GNorm = 1.5658, lr_0 = 9.9789e-04
Validation auc = 0.727281
Epoch 3400
Loss = 2.9749e-02, PNorm = 309.7077, GNorm = 0.3552, lr_0 = 9.9789e-04
Validation auc = 0.729853
Epoch 3401
Loss = 1.0346e-02, PNorm = 309.7451, GNorm = 0.2474, lr_0 = 9.9789e-04
Validation auc = 0.726743
Epoch 3402
Loss = 2.3030e-02, PNorm = 309.7867, GNorm = 5.1041, lr_0 = 9.9789e-04
Validation auc = 0.729649
Epoch 3403
Loss = 1.4367e-02, PNorm = 309.8385, GNorm = 0.2742, lr_0 = 9.9789e-04
Validation auc = 0.737831
Epoch 3404
Loss = 3.1195e-02, PNorm = 309.8853, GNorm = 3.1761, lr_0 = 9.9788e-04
Validation auc = 0.734045
Epoch 3405
Loss = 3.3073e-03, PNorm = 309.9272, GNorm = 0.1572, lr_0 = 9.9788e-04
Validation auc = 0.731602
Epoch 3406
Loss = 3.0904e-02, PNorm = 309.9696, GNorm = 1.0674, lr_0 = 9.9788e-04
Validation auc = 0.728607
Epoch 3407
Loss = 6.1963e-03, PNorm = 310.0177, GNorm = 0.4760, lr_0 = 9.9788e-04
Validation auc = 0.721360
Epoch 3408
Loss = 8.3487e-02, PNorm = 310.0611, GNorm = 0.0211, lr_0 = 9.9788e-04
Validation auc = 0.717304
Epoch 3409
Loss = 3.6934e-02, PNorm = 310.0960, GNorm = 1.3239, lr_0 = 9.9788e-04
Loss = 1.4555e-02, PNorm = 310.1396, GNorm = 0.3849, lr_0 = 9.9788e-04
Validation auc = 0.713096
Epoch 3410
Loss = 1.6894e-02, PNorm = 310.1791, GNorm = 0.0227, lr_0 = 9.9788e-04
Validation auc = 0.706458
Epoch 3411
Loss = 1.7209e-02, PNorm = 310.2179, GNorm = 1.3242, lr_0 = 9.9788e-04
Validation auc = 0.697461
Epoch 3412
Loss = 3.5971e-02, PNorm = 310.2561, GNorm = 1.1892, lr_0 = 9.9788e-04
Validation auc = 0.700953
Epoch 3413
Loss = 2.0042e-02, PNorm = 310.3103, GNorm = 0.9464, lr_0 = 9.9788e-04
Validation auc = 0.702894
Epoch 3414
Loss = 2.7716e-02, PNorm = 310.3636, GNorm = 0.6944, lr_0 = 9.9788e-04
Validation auc = 0.697547
Epoch 3415
Loss = 2.3960e-02, PNorm = 310.4131, GNorm = 0.9469, lr_0 = 9.9788e-04
Validation auc = 0.696780
Epoch 3416
Loss = 4.3208e-02, PNorm = 310.4559, GNorm = 2.9871, lr_0 = 9.9788e-04
Validation auc = 0.705449
Epoch 3417
Loss = 8.3894e-03, PNorm = 310.5171, GNorm = 0.7087, lr_0 = 9.9787e-04
Validation auc = 0.712082
Epoch 3418
Loss = 5.1310e-03, PNorm = 310.5854, GNorm = 0.2405, lr_0 = 9.9787e-04
Validation auc = 0.720980
Epoch 3419
Loss = 3.7213e-03, PNorm = 310.6498, GNorm = 0.1565, lr_0 = 9.9787e-04
Loss = 5.2565e-02, PNorm = 310.7182, GNorm = 0.1178, lr_0 = 9.9787e-04
Validation auc = 0.730785
Epoch 3420
Loss = 2.4165e-02, PNorm = 310.7859, GNorm = 1.2747, lr_0 = 9.9787e-04
Validation auc = 0.725614
Epoch 3421
Loss = 4.9950e-02, PNorm = 310.8530, GNorm = 1.6080, lr_0 = 9.9787e-04
Validation auc = 0.702816
Epoch 3422
Loss = 4.1833e-02, PNorm = 310.9214, GNorm = 1.0259, lr_0 = 9.9787e-04
Validation auc = 0.704157
Epoch 3423
Loss = 2.7106e-02, PNorm = 310.9949, GNorm = 0.3592, lr_0 = 9.9787e-04
Validation auc = 0.704738
Epoch 3424
Loss = 1.6622e-02, PNorm = 311.0818, GNorm = 0.0825, lr_0 = 9.9787e-04
Validation auc = 0.687693
Epoch 3425
Loss = 1.0708e-02, PNorm = 311.1647, GNorm = 0.7308, lr_0 = 9.9787e-04
Validation auc = 0.695036
Epoch 3426
Loss = 6.6980e-03, PNorm = 311.2177, GNorm = 0.6382, lr_0 = 9.9787e-04
Validation auc = 0.692269
Epoch 3427
Loss = 5.1812e-03, PNorm = 311.2523, GNorm = 0.2583, lr_0 = 9.9787e-04
Validation auc = 0.695264
Epoch 3428
Loss = 5.6528e-03, PNorm = 311.2957, GNorm = 0.4096, lr_0 = 9.9787e-04
Validation auc = 0.709539
Epoch 3429
Loss = 2.0199e-02, PNorm = 311.3645, GNorm = 1.6383, lr_0 = 9.9787e-04
Loss = 4.9608e-02, PNorm = 311.4309, GNorm = 1.0724, lr_0 = 9.9787e-04
Validation auc = 0.713795
Epoch 3430
Loss = 2.4201e-02, PNorm = 311.5038, GNorm = 0.1619, lr_0 = 9.9786e-04
Validation auc = 0.705298
Epoch 3431
Loss = 7.4094e-02, PNorm = 311.5732, GNorm = 0.1622, lr_0 = 9.9786e-04
Validation auc = 0.711524
Epoch 3432
Loss = 1.6338e-02, PNorm = 311.6449, GNorm = 1.7306, lr_0 = 9.9786e-04
Validation auc = 0.710875
Epoch 3433
Loss = 5.5825e-02, PNorm = 311.7046, GNorm = 0.7995, lr_0 = 9.9786e-04
Validation auc = 0.702537
Epoch 3434
Loss = 3.5717e-02, PNorm = 311.7712, GNorm = 1.3886, lr_0 = 9.9786e-04
Validation auc = 0.695726
Epoch 3435
Loss = 3.5538e-02, PNorm = 311.8413, GNorm = 0.2907, lr_0 = 9.9786e-04
Validation auc = 0.693324
Epoch 3436
Loss = 3.4834e-02, PNorm = 311.8959, GNorm = 1.3187, lr_0 = 9.9786e-04
Validation auc = 0.691206
Epoch 3437
Loss = 4.8256e-02, PNorm = 311.9469, GNorm = 1.7281, lr_0 = 9.9786e-04
Validation auc = 0.695809
Epoch 3438
Loss = 4.5655e-03, PNorm = 311.9866, GNorm = 0.1208, lr_0 = 9.9786e-04
Validation auc = 0.694863
Epoch 3439
Loss = 1.6302e-02, PNorm = 312.0208, GNorm = 0.9023, lr_0 = 9.9786e-04
Loss = 2.8394e-02, PNorm = 312.0515, GNorm = 0.3464, lr_0 = 9.9786e-04
Validation auc = 0.690908
Epoch 3440
Loss = 1.9006e-02, PNorm = 312.0747, GNorm = 1.1036, lr_0 = 9.9786e-04
Validation auc = 0.688714
Epoch 3441
Loss = 2.4311e-02, PNorm = 312.1044, GNorm = 1.4330, lr_0 = 9.9786e-04
Validation auc = 0.688276
Epoch 3442
Loss = 3.9953e-02, PNorm = 312.1412, GNorm = 3.9256, lr_0 = 9.9786e-04
Validation auc = 0.684113
Epoch 3443
Loss = 3.6055e-02, PNorm = 312.1822, GNorm = 0.4522, lr_0 = 9.9785e-04
Validation auc = 0.676712
Epoch 3444
Loss = 1.7271e-02, PNorm = 312.2208, GNorm = 3.0903, lr_0 = 9.9785e-04
Validation auc = 0.673388
Epoch 3445
Loss = 5.0651e-02, PNorm = 312.2563, GNorm = 2.4037, lr_0 = 9.9785e-04
Validation auc = 0.665492
Epoch 3446
Loss = 3.3563e-02, PNorm = 312.3125, GNorm = 0.1544, lr_0 = 9.9785e-04
Validation auc = 0.658158
Epoch 3447
Loss = 2.4627e-02, PNorm = 312.3620, GNorm = 0.3376, lr_0 = 9.9785e-04
Validation auc = 0.669170
Epoch 3448
Loss = 1.4925e-02, PNorm = 312.4018, GNorm = 1.1257, lr_0 = 9.9785e-04
Validation auc = 0.673254
Epoch 3449
Loss = 8.6440e-04, PNorm = 312.4377, GNorm = 0.0395, lr_0 = 9.9785e-04
Loss = 3.2605e-02, PNorm = 312.4800, GNorm = 0.8712, lr_0 = 9.9785e-04
Validation auc = 0.675235
Epoch 3450
Loss = 2.1682e-02, PNorm = 312.5370, GNorm = 0.0943, lr_0 = 9.9785e-04
Validation auc = 0.694908
Epoch 3451
Loss = 3.7364e-02, PNorm = 312.5993, GNorm = 0.0316, lr_0 = 9.9785e-04
Validation auc = 0.703417
Epoch 3452
Loss = 2.1062e-02, PNorm = 312.6569, GNorm = 0.1310, lr_0 = 9.9785e-04
Validation auc = 0.713489
Epoch 3453
Loss = 2.5076e-02, PNorm = 312.7026, GNorm = 0.0918, lr_0 = 9.9785e-04
Validation auc = 0.709688
Epoch 3454
Loss = 3.0795e-02, PNorm = 312.7551, GNorm = 0.8474, lr_0 = 9.9785e-04
Validation auc = 0.702977
Epoch 3455
Loss = 1.1257e-02, PNorm = 312.8068, GNorm = 0.2384, lr_0 = 9.9785e-04
Validation auc = 0.699392
Epoch 3456
Loss = 7.8646e-03, PNorm = 312.8563, GNorm = 0.6309, lr_0 = 9.9785e-04
Validation auc = 0.693940
Epoch 3457
Loss = 1.2486e-02, PNorm = 312.8997, GNorm = 0.9808, lr_0 = 9.9784e-04
Validation auc = 0.698321
Epoch 3458
Loss = 1.8851e-02, PNorm = 312.9673, GNorm = 1.6566, lr_0 = 9.9784e-04
Validation auc = 0.702118
Epoch 3459
Loss = 3.0299e-03, PNorm = 313.0273, GNorm = 0.1238, lr_0 = 9.9784e-04
Loss = 2.7662e-02, PNorm = 313.0722, GNorm = 0.7732, lr_0 = 9.9784e-04
Validation auc = 0.701528
Epoch 3460
Loss = 2.9215e-02, PNorm = 313.1309, GNorm = 0.4971, lr_0 = 9.9784e-04
Validation auc = 0.696873
Epoch 3461
Loss = 2.7389e-02, PNorm = 313.1979, GNorm = 2.7158, lr_0 = 9.9784e-04
Validation auc = 0.690668
Epoch 3462
Loss = 2.0555e-02, PNorm = 313.2572, GNorm = 2.8772, lr_0 = 9.9784e-04
Validation auc = 0.691007
Epoch 3463
Loss = 1.2364e-02, PNorm = 313.3048, GNorm = 2.2873, lr_0 = 9.9784e-04
Validation auc = 0.690014
Epoch 3464
Loss = 2.4737e-02, PNorm = 313.3560, GNorm = 0.5304, lr_0 = 9.9784e-04
Validation auc = 0.692861
Epoch 3465
Loss = 1.4277e-02, PNorm = 313.4188, GNorm = 0.9073, lr_0 = 9.9784e-04
Validation auc = 0.691774
Epoch 3466
Loss = 8.1484e-03, PNorm = 313.4720, GNorm = 0.0679, lr_0 = 9.9784e-04
Validation auc = 0.689423
Epoch 3467
Loss = 2.6151e-02, PNorm = 313.5179, GNorm = 1.6676, lr_0 = 9.9784e-04
Validation auc = 0.695026
Epoch 3468
Loss = 7.7674e-03, PNorm = 313.5704, GNorm = 0.6688, lr_0 = 9.9784e-04
Validation auc = 0.702741
Epoch 3469
Loss = 1.5506e-02, PNorm = 313.6238, GNorm = 2.0551, lr_0 = 9.9784e-04
Loss = 2.6199e-02, PNorm = 313.6875, GNorm = 0.1535, lr_0 = 9.9783e-04
Validation auc = 0.701081
Epoch 3470
Loss = 1.1043e-02, PNorm = 313.7479, GNorm = 0.0513, lr_0 = 9.9783e-04
Validation auc = 0.699164
Epoch 3471
Loss = 5.4062e-02, PNorm = 313.7880, GNorm = 0.0533, lr_0 = 9.9783e-04
Validation auc = 0.713418
Epoch 3472
Loss = 1.1820e-02, PNorm = 313.8446, GNorm = 1.0464, lr_0 = 9.9783e-04
Validation auc = 0.736553
Epoch 3473
Loss = 7.1928e-02, PNorm = 313.8968, GNorm = 3.2858, lr_0 = 9.9783e-04
Validation auc = 0.737114
Epoch 3474
Loss = 5.1062e-02, PNorm = 313.9719, GNorm = 1.1669, lr_0 = 9.9783e-04
Validation auc = 0.737643
Epoch 3475
Loss = 1.9471e-02, PNorm = 314.0506, GNorm = 1.6511, lr_0 = 9.9783e-04
Validation auc = 0.739799
Epoch 3476
Loss = 2.5557e-02, PNorm = 314.1117, GNorm = 0.2763, lr_0 = 9.9783e-04
Validation auc = 0.734158
Epoch 3477
Loss = 2.3412e-02, PNorm = 314.1569, GNorm = 0.3243, lr_0 = 9.9783e-04
Validation auc = 0.732531
Epoch 3478
Loss = 2.7767e-03, PNorm = 314.1910, GNorm = 0.0755, lr_0 = 9.9783e-04
Validation auc = 0.730970
Epoch 3479
Loss = 2.4485e-03, PNorm = 314.2185, GNorm = 0.1866, lr_0 = 9.9783e-04
Loss = 5.0892e-02, PNorm = 314.2513, GNorm = 1.4549, lr_0 = 9.9783e-04
Validation auc = 0.716380
Epoch 3480
Loss = 2.1085e-02, PNorm = 314.2977, GNorm = 0.1840, lr_0 = 9.9783e-04
Validation auc = 0.709451
Epoch 3481
Loss = 3.2243e-02, PNorm = 314.3423, GNorm = 0.0265, lr_0 = 9.9783e-04
Validation auc = 0.708311
Epoch 3482
Loss = 2.0273e-02, PNorm = 314.3880, GNorm = 1.0594, lr_0 = 9.9783e-04
Validation auc = 0.711682
Epoch 3483
Loss = 2.7840e-02, PNorm = 314.4254, GNorm = 0.1177, lr_0 = 9.9782e-04
Validation auc = 0.712643
Epoch 3484
Loss = 5.4823e-03, PNorm = 314.4659, GNorm = 0.1587, lr_0 = 9.9782e-04
Validation auc = 0.712602
Epoch 3485
Loss = 7.4799e-03, PNorm = 314.4984, GNorm = 0.0178, lr_0 = 9.9782e-04
Validation auc = 0.716878
Epoch 3486
Loss = 2.2664e-03, PNorm = 314.5245, GNorm = 0.0528, lr_0 = 9.9782e-04
Validation auc = 0.718160
Epoch 3487
Loss = 3.6989e-02, PNorm = 314.5457, GNorm = 1.4365, lr_0 = 9.9782e-04
Validation auc = 0.719818
Epoch 3488
Loss = 5.0158e-02, PNorm = 314.5681, GNorm = 5.9615, lr_0 = 9.9782e-04
Validation auc = 0.728465
Epoch 3489
Loss = 1.1401e-02, PNorm = 314.6048, GNorm = 1.0770, lr_0 = 9.9782e-04
Loss = 2.4465e-02, PNorm = 314.6383, GNorm = 0.0567, lr_0 = 9.9782e-04
Validation auc = 0.739040
Epoch 3490
Loss = 8.9105e-03, PNorm = 314.6772, GNorm = 0.0838, lr_0 = 9.9782e-04
Validation auc = 0.749806
Epoch 3491
Loss = 2.8087e-02, PNorm = 314.7160, GNorm = 2.6073, lr_0 = 9.9782e-04
Validation auc = 0.750760
Epoch 3492
Loss = 2.6467e-02, PNorm = 314.7615, GNorm = 1.4202, lr_0 = 9.9782e-04
Validation auc = 0.741862
Epoch 3493
Loss = 1.8509e-02, PNorm = 314.8093, GNorm = 0.4847, lr_0 = 9.9782e-04
Validation auc = 0.731868
Epoch 3494
Loss = 7.6969e-03, PNorm = 314.8591, GNorm = 0.2105, lr_0 = 9.9782e-04
Validation auc = 0.724765
Epoch 3495
Loss = 6.7778e-02, PNorm = 314.9009, GNorm = 1.9749, lr_0 = 9.9782e-04
Validation auc = 0.730592
Epoch 3496
Loss = 4.1588e-02, PNorm = 314.9360, GNorm = 0.1628, lr_0 = 9.9781e-04
Validation auc = 0.729347
Epoch 3497
Loss = 1.0738e-02, PNorm = 314.9803, GNorm = 0.4723, lr_0 = 9.9781e-04
Validation auc = 0.725837
Epoch 3498
Loss = 8.2449e-02, PNorm = 315.0209, GNorm = 1.8602, lr_0 = 9.9781e-04
Validation auc = 0.729621
Epoch 3499
Loss = 1.1935e-02, PNorm = 315.0671, GNorm = 0.3868, lr_0 = 9.9781e-04
Loss = 3.6724e-02, PNorm = 315.1193, GNorm = 0.4259, lr_0 = 9.9781e-04
Validation auc = 0.723391
Epoch 3500
Loss = 1.5906e-02, PNorm = 315.1601, GNorm = 1.3717, lr_0 = 9.9781e-04
Validation auc = 0.722579
Epoch 3501
Loss = 1.9504e-02, PNorm = 315.1976, GNorm = 0.0960, lr_0 = 9.9781e-04
Validation auc = 0.712635
Epoch 3502
Loss = 3.1058e-02, PNorm = 315.2324, GNorm = 0.1014, lr_0 = 9.9781e-04
Validation auc = 0.713750
Epoch 3503
Loss = 4.3041e-02, PNorm = 315.2700, GNorm = 0.2332, lr_0 = 9.9781e-04
Validation auc = 0.710771
Epoch 3504
Loss = 4.5828e-02, PNorm = 315.3136, GNorm = 1.0322, lr_0 = 9.9781e-04
Validation auc = 0.710539
Epoch 3505
Loss = 4.5964e-03, PNorm = 315.3792, GNorm = 0.4846, lr_0 = 9.9781e-04
Validation auc = 0.709469
Epoch 3506
Loss = 2.6659e-02, PNorm = 315.4373, GNorm = 1.6909, lr_0 = 9.9781e-04
Validation auc = 0.704086
Epoch 3507
Loss = 4.0472e-03, PNorm = 315.4887, GNorm = 0.0480, lr_0 = 9.9781e-04
Validation auc = 0.702371
Epoch 3508
Loss = 4.4766e-02, PNorm = 315.5332, GNorm = 0.6391, lr_0 = 9.9781e-04
Validation auc = 0.697627
Epoch 3509
Loss = 1.9107e-02, PNorm = 315.5698, GNorm = 0.5681, lr_0 = 9.9781e-04
Loss = 1.9683e-02, PNorm = 315.6094, GNorm = 0.1815, lr_0 = 9.9780e-04
Validation auc = 0.705995
Epoch 3510
Loss = 3.0832e-02, PNorm = 315.6450, GNorm = 1.4595, lr_0 = 9.9780e-04
Validation auc = 0.716614
Epoch 3511
Loss = 1.2040e-02, PNorm = 315.6812, GNorm = 0.0516, lr_0 = 9.9780e-04
Validation auc = 0.721855
Epoch 3512
Loss = 1.9853e-02, PNorm = 315.7098, GNorm = 0.0567, lr_0 = 9.9780e-04
Validation auc = 0.728793
Epoch 3513
Loss = 3.8222e-02, PNorm = 315.7400, GNorm = 0.2060, lr_0 = 9.9780e-04
Validation auc = 0.722847
Epoch 3514
Loss = 4.6930e-02, PNorm = 315.7762, GNorm = 0.2215, lr_0 = 9.9780e-04
Validation auc = 0.709195
Epoch 3515
Loss = 9.1213e-03, PNorm = 315.8232, GNorm = 0.0990, lr_0 = 9.9780e-04
Validation auc = 0.713288
Epoch 3516
Loss = 1.7670e-02, PNorm = 315.8660, GNorm = 0.8459, lr_0 = 9.9780e-04
Validation auc = 0.727606
Epoch 3517
Loss = 5.9907e-03, PNorm = 315.9109, GNorm = 0.0717, lr_0 = 9.9780e-04
Validation auc = 0.732910
Epoch 3518
Loss = 9.0827e-03, PNorm = 315.9454, GNorm = 0.3058, lr_0 = 9.9780e-04
Validation auc = 0.736912
Epoch 3519
Loss = 9.1863e-02, PNorm = 315.9804, GNorm = 1.3756, lr_0 = 9.9780e-04
Loss = 2.7401e-02, PNorm = 316.0196, GNorm = 0.1754, lr_0 = 9.9780e-04
Validation auc = 0.735936
Epoch 3520
Loss = 1.2095e-02, PNorm = 316.0610, GNorm = 0.0782, lr_0 = 9.9780e-04
Validation auc = 0.722702
Epoch 3521
Loss = 1.9928e-02, PNorm = 316.1039, GNorm = 0.0393, lr_0 = 9.9780e-04
Validation auc = 0.710630
Epoch 3522
Loss = 6.7940e-03, PNorm = 316.1477, GNorm = 0.0844, lr_0 = 9.9780e-04
Validation auc = 0.708059
Epoch 3523
Loss = 1.2551e-02, PNorm = 316.1805, GNorm = 1.8392, lr_0 = 9.9779e-04
Validation auc = 0.708217
Epoch 3524
Loss = 3.2708e-02, PNorm = 316.2046, GNorm = 0.1199, lr_0 = 9.9779e-04
Validation auc = 0.703264
Epoch 3525
Loss = 1.8399e-02, PNorm = 316.2329, GNorm = 0.1438, lr_0 = 9.9779e-04
Validation auc = 0.688510
Epoch 3526
Loss = 3.7019e-02, PNorm = 316.2709, GNorm = 1.8913, lr_0 = 9.9779e-04
Validation auc = 0.679603
Epoch 3527
Loss = 2.0182e-03, PNorm = 316.3249, GNorm = 0.1037, lr_0 = 9.9779e-04
Validation auc = 0.685400
Epoch 3528
Loss = 1.6117e-03, PNorm = 316.3599, GNorm = 0.0809, lr_0 = 9.9779e-04
Validation auc = 0.690700
Epoch 3529
Loss = 6.6701e-04, PNorm = 316.3856, GNorm = 0.0249, lr_0 = 9.9779e-04
Loss = 2.3801e-02, PNorm = 316.4139, GNorm = 0.2629, lr_0 = 9.9779e-04
Validation auc = 0.696071
Epoch 3530
Loss = 4.8311e-02, PNorm = 316.4607, GNorm = 0.0106, lr_0 = 9.9779e-04
Validation auc = 0.701115
Epoch 3531
Loss = 1.5253e-02, PNorm = 316.5160, GNorm = 0.3668, lr_0 = 9.9779e-04
Validation auc = 0.707719
Epoch 3532
Loss = 1.8199e-02, PNorm = 316.5595, GNorm = 0.9158, lr_0 = 9.9779e-04
Validation auc = 0.702935
Epoch 3533
Loss = 4.4294e-02, PNorm = 316.6076, GNorm = 0.1379, lr_0 = 9.9779e-04
Validation auc = 0.706580
Epoch 3534
Loss = 8.9270e-03, PNorm = 316.6621, GNorm = 0.0803, lr_0 = 9.9779e-04
Validation auc = 0.717218
Epoch 3535
Loss = 9.4549e-02, PNorm = 316.7123, GNorm = 1.5357, lr_0 = 9.9779e-04
Validation auc = 0.700544
Epoch 3536
Loss = 3.5817e-02, PNorm = 316.8196, GNorm = 0.7490, lr_0 = 9.9778e-04
Validation auc = 0.698642
Epoch 3537
Loss = 3.7257e-02, PNorm = 316.9075, GNorm = 0.8333, lr_0 = 9.9778e-04
Validation auc = 0.712253
Epoch 3538
Loss = 1.1963e-02, PNorm = 316.9683, GNorm = 0.6546, lr_0 = 9.9778e-04
Validation auc = 0.712683
Epoch 3539
Loss = 3.7387e-03, PNorm = 317.0152, GNorm = 0.1070, lr_0 = 9.9778e-04
Loss = 2.7507e-02, PNorm = 317.0615, GNorm = 0.0650, lr_0 = 9.9778e-04
Validation auc = 0.714958
Epoch 3540
Loss = 3.6781e-02, PNorm = 317.1272, GNorm = 0.0872, lr_0 = 9.9778e-04
Validation auc = 0.727955
Epoch 3541
Loss = 3.9923e-02, PNorm = 317.1963, GNorm = 0.2498, lr_0 = 9.9778e-04
Validation auc = 0.723620
Epoch 3542
Loss = 1.0773e-02, PNorm = 317.2496, GNorm = 0.4821, lr_0 = 9.9778e-04
Validation auc = 0.721319
Epoch 3543
Loss = 1.6530e-02, PNorm = 317.2869, GNorm = 0.2911, lr_0 = 9.9778e-04
Validation auc = 0.719136
Epoch 3544
Loss = 2.7867e-02, PNorm = 317.3175, GNorm = 0.4038, lr_0 = 9.9778e-04
Validation auc = 0.717633
Epoch 3545
Loss = 2.0355e-02, PNorm = 317.3549, GNorm = 0.0130, lr_0 = 9.9778e-04
Validation auc = 0.714009
Epoch 3546
Loss = 3.3124e-02, PNorm = 317.3900, GNorm = 1.1528, lr_0 = 9.9778e-04
Validation auc = 0.712204
Epoch 3547
Loss = 9.0246e-02, PNorm = 317.4434, GNorm = 0.6018, lr_0 = 9.9778e-04
Validation auc = 0.698498
Epoch 3548
Loss = 9.3174e-02, PNorm = 317.5260, GNorm = 0.4646, lr_0 = 9.9778e-04
Validation auc = 0.694526
Epoch 3549
Loss = 1.0113e-02, PNorm = 317.6006, GNorm = 0.5459, lr_0 = 9.9778e-04
Loss = 5.0187e-02, PNorm = 317.6637, GNorm = 0.8528, lr_0 = 9.9777e-04
Validation auc = 0.682304
Epoch 3550
Loss = 1.5161e-02, PNorm = 317.7151, GNorm = 0.6848, lr_0 = 9.9777e-04
Validation auc = 0.680805
Epoch 3551
Loss = 1.6672e-02, PNorm = 317.7542, GNorm = 0.1308, lr_0 = 9.9777e-04
Validation auc = 0.683623
Epoch 3552
Loss = 2.7290e-02, PNorm = 317.7891, GNorm = 1.6827, lr_0 = 9.9777e-04
Validation auc = 0.694100
Epoch 3553
Loss = 1.4486e-02, PNorm = 317.8233, GNorm = 0.1710, lr_0 = 9.9777e-04
Validation auc = 0.699271
Epoch 3554
Loss = 4.7233e-02, PNorm = 317.8656, GNorm = 0.4484, lr_0 = 9.9777e-04
Validation auc = 0.697481
Epoch 3555
Loss = 1.9920e-02, PNorm = 317.9108, GNorm = 0.4460, lr_0 = 9.9777e-04
Validation auc = 0.703043
Epoch 3556
Loss = 3.2039e-02, PNorm = 317.9538, GNorm = 1.3153, lr_0 = 9.9777e-04
Validation auc = 0.705379
Epoch 3557
Loss = 3.1988e-03, PNorm = 317.9950, GNorm = 0.0530, lr_0 = 9.9777e-04
Validation auc = 0.705017
Epoch 3558
Loss = 7.6225e-03, PNorm = 318.0284, GNorm = 0.7691, lr_0 = 9.9777e-04
Validation auc = 0.702662
Epoch 3559
Loss = 2.2478e-02, PNorm = 318.0641, GNorm = 0.8450, lr_0 = 9.9777e-04
Loss = 3.7356e-02, PNorm = 318.0933, GNorm = 1.2998, lr_0 = 9.9777e-04
Validation auc = 0.704314
Epoch 3560
Loss = 1.2360e-02, PNorm = 318.1268, GNorm = 0.6024, lr_0 = 9.9777e-04
Validation auc = 0.706727
Epoch 3561
Loss = 3.9531e-02, PNorm = 318.1507, GNorm = 0.0783, lr_0 = 9.9777e-04
Validation auc = 0.698085
Epoch 3562
Loss = 1.0423e-02, PNorm = 318.1809, GNorm = 0.2755, lr_0 = 9.9776e-04
Validation auc = 0.696439
Epoch 3563
Loss = 6.6199e-03, PNorm = 318.2146, GNorm = 0.2052, lr_0 = 9.9776e-04
Validation auc = 0.703729
Epoch 3564
Loss = 1.6927e-02, PNorm = 318.2459, GNorm = 1.5291, lr_0 = 9.9776e-04
Validation auc = 0.707472
Epoch 3565
Loss = 4.0262e-02, PNorm = 318.2899, GNorm = 4.7857, lr_0 = 9.9776e-04
Validation auc = 0.706459
Epoch 3566
Loss = 2.4187e-02, PNorm = 318.3626, GNorm = 2.0232, lr_0 = 9.9776e-04
Validation auc = 0.691968
Epoch 3567
Loss = 2.4536e-02, PNorm = 318.4267, GNorm = 0.6126, lr_0 = 9.9776e-04
Validation auc = 0.686918
Epoch 3568
Loss = 9.9793e-04, PNorm = 318.4919, GNorm = 0.0169, lr_0 = 9.9776e-04
Validation auc = 0.687642
Epoch 3569
Loss = 6.8868e-02, PNorm = 318.5421, GNorm = 1.4716, lr_0 = 9.9776e-04
Loss = 3.6048e-02, PNorm = 318.6004, GNorm = 1.0312, lr_0 = 9.9776e-04
Validation auc = 0.694403
Epoch 3570
Loss = 3.2485e-02, PNorm = 318.6710, GNorm = 0.3067, lr_0 = 9.9776e-04
Validation auc = 0.699366
Epoch 3571
Loss = 3.6645e-02, PNorm = 318.7324, GNorm = 0.1685, lr_0 = 9.9776e-04
Validation auc = 0.697639
Epoch 3572
Loss = 5.1614e-02, PNorm = 318.7873, GNorm = 1.6257, lr_0 = 9.9776e-04
Validation auc = 0.699880
Epoch 3573
Loss = 4.2838e-02, PNorm = 318.8504, GNorm = 0.1338, lr_0 = 9.9776e-04
Validation auc = 0.696923
Epoch 3574
Loss = 3.8700e-02, PNorm = 318.9181, GNorm = 1.1887, lr_0 = 9.9776e-04
Validation auc = 0.702506
Epoch 3575
Loss = 3.8150e-02, PNorm = 318.9799, GNorm = 1.4198, lr_0 = 9.9776e-04
Validation auc = 0.703595
Epoch 3576
Loss = 1.7233e-02, PNorm = 319.0241, GNorm = 0.1055, lr_0 = 9.9775e-04
Validation auc = 0.703961
Epoch 3577
Loss = 2.4240e-03, PNorm = 319.0629, GNorm = 0.0346, lr_0 = 9.9775e-04
Validation auc = 0.707922
Epoch 3578
Loss = 4.5590e-03, PNorm = 319.0934, GNorm = 0.6009, lr_0 = 9.9775e-04
Validation auc = 0.705168
Epoch 3579
Loss = 4.4702e-03, PNorm = 319.1334, GNorm = 0.1343, lr_0 = 9.9775e-04
Loss = 2.7115e-02, PNorm = 319.1668, GNorm = 0.3307, lr_0 = 9.9775e-04
Validation auc = 0.699388
Epoch 3580
Loss = 6.0642e-02, PNorm = 319.1951, GNorm = 0.0281, lr_0 = 9.9775e-04
Validation auc = 0.700291
Epoch 3581
Loss = 2.9462e-02, PNorm = 319.2290, GNorm = 0.5305, lr_0 = 9.9775e-04
Validation auc = 0.716074
Epoch 3582
Loss = 1.5417e-02, PNorm = 319.2780, GNorm = 0.1148, lr_0 = 9.9775e-04
Validation auc = 0.726272
Epoch 3583
Loss = 3.5455e-02, PNorm = 319.3195, GNorm = 0.0553, lr_0 = 9.9775e-04
Validation auc = 0.724809
Epoch 3584
Loss = 5.0317e-02, PNorm = 319.3672, GNorm = 1.6650, lr_0 = 9.9775e-04
Validation auc = 0.706465
Epoch 3585
Loss = 5.1161e-02, PNorm = 319.4325, GNorm = 0.3279, lr_0 = 9.9775e-04
Validation auc = 0.702933
Epoch 3586
Loss = 5.9856e-02, PNorm = 319.4978, GNorm = 1.1062, lr_0 = 9.9775e-04
Validation auc = 0.708208
Epoch 3587
Loss = 6.8850e-02, PNorm = 319.5548, GNorm = 0.9987, lr_0 = 9.9775e-04
Validation auc = 0.709380
Epoch 3588
Loss = 2.9363e-02, PNorm = 319.6226, GNorm = 1.4640, lr_0 = 9.9775e-04
Validation auc = 0.715274
Epoch 3589
Loss = 1.3937e-01, PNorm = 319.6872, GNorm = 2.9752, lr_0 = 9.9774e-04
Loss = 3.8985e-02, PNorm = 319.7757, GNorm = 0.4909, lr_0 = 9.9774e-04
Validation auc = 0.715168
Epoch 3590
Loss = 3.8165e-02, PNorm = 319.8421, GNorm = 0.5177, lr_0 = 9.9774e-04
Validation auc = 0.720697
Epoch 3591
Loss = 1.3863e-02, PNorm = 319.8921, GNorm = 0.0701, lr_0 = 9.9774e-04
Validation auc = 0.721005
Epoch 3592
Loss = 1.3536e-02, PNorm = 319.9269, GNorm = 1.0393, lr_0 = 9.9774e-04
Validation auc = 0.720025
Epoch 3593
Loss = 1.5112e-02, PNorm = 319.9548, GNorm = 0.6868, lr_0 = 9.9774e-04
Validation auc = 0.720221
Epoch 3594
Loss = 2.9206e-02, PNorm = 319.9841, GNorm = 0.1195, lr_0 = 9.9774e-04
Validation auc = 0.723449
Epoch 3595
Loss = 4.8830e-02, PNorm = 320.0317, GNorm = 0.0863, lr_0 = 9.9774e-04
Validation auc = 0.720685
Epoch 3596
Loss = 1.6084e-02, PNorm = 320.0898, GNorm = 0.1148, lr_0 = 9.9774e-04
Validation auc = 0.717834
Epoch 3597
Loss = 2.0183e-02, PNorm = 320.1381, GNorm = 0.4008, lr_0 = 9.9774e-04
Validation auc = 0.719476
Epoch 3598
Loss = 8.2406e-02, PNorm = 320.1827, GNorm = 0.2983, lr_0 = 9.9774e-04
Validation auc = 0.714927
Epoch 3599
Loss = 9.8352e-02, PNorm = 320.2305, GNorm = 3.3371, lr_0 = 9.9774e-04
Loss = 5.3843e-02, PNorm = 320.2912, GNorm = 0.4192, lr_0 = 9.9774e-04
Validation auc = 0.705279
Epoch 3600
Loss = 2.8737e-02, PNorm = 320.3496, GNorm = 0.5508, lr_0 = 9.9774e-04
Validation auc = 0.712201
Epoch 3601
Loss = 1.8080e-02, PNorm = 320.4037, GNorm = 0.3472, lr_0 = 9.9774e-04
Validation auc = 0.722490
Epoch 3602
Loss = 8.7146e-02, PNorm = 320.4562, GNorm = 4.5919, lr_0 = 9.9773e-04
Validation auc = 0.731980
Epoch 3603
Loss = 2.9016e-02, PNorm = 320.5338, GNorm = 1.3363, lr_0 = 9.9773e-04
Validation auc = 0.725992
Epoch 3604
Loss = 1.5702e-02, PNorm = 320.5943, GNorm = 0.9476, lr_0 = 9.9773e-04
Validation auc = 0.730294
Epoch 3605
Loss = 9.4692e-02, PNorm = 320.6474, GNorm = 0.2297, lr_0 = 9.9773e-04
Validation auc = 0.726520
Epoch 3606
Loss = 4.1781e-02, PNorm = 320.7096, GNorm = 0.3869, lr_0 = 9.9773e-04
Validation auc = 0.724765
Epoch 3607
Loss = 1.8868e-02, PNorm = 320.7814, GNorm = 0.3899, lr_0 = 9.9773e-04
Validation auc = 0.716089
Epoch 3608
Loss = 2.6330e-02, PNorm = 320.8433, GNorm = 1.0026, lr_0 = 9.9773e-04
Validation auc = 0.718388
Epoch 3609
Loss = 7.7798e-02, PNorm = 320.8892, GNorm = 1.6344, lr_0 = 9.9773e-04
Loss = 2.2147e-02, PNorm = 320.9287, GNorm = 1.2102, lr_0 = 9.9773e-04
Validation auc = 0.714007
Epoch 3610
Loss = 1.6780e-02, PNorm = 320.9679, GNorm = 0.8722, lr_0 = 9.9773e-04
Validation auc = 0.708792
Epoch 3611
Loss = 6.8457e-03, PNorm = 320.9994, GNorm = 0.0236, lr_0 = 9.9773e-04
Validation auc = 0.712022
Epoch 3612
Loss = 4.2661e-02, PNorm = 321.0250, GNorm = 1.6681, lr_0 = 9.9773e-04
Validation auc = 0.729992
Epoch 3613
Loss = 2.2984e-02, PNorm = 321.0720, GNorm = 0.4273, lr_0 = 9.9773e-04
Validation auc = 0.735631
Epoch 3614
Loss = 1.0362e-02, PNorm = 321.1127, GNorm = 0.0371, lr_0 = 9.9773e-04
Validation auc = 0.734011
Epoch 3615
Loss = 2.4942e-02, PNorm = 321.1461, GNorm = 1.3350, lr_0 = 9.9772e-04
Validation auc = 0.736354
Epoch 3616
Loss = 6.5134e-02, PNorm = 321.1777, GNorm = 4.0661, lr_0 = 9.9772e-04
Validation auc = 0.734659
Epoch 3617
Loss = 2.5951e-02, PNorm = 321.2152, GNorm = 1.3426, lr_0 = 9.9772e-04
Validation auc = 0.736880
Epoch 3618
Loss = 2.2180e-02, PNorm = 321.2602, GNorm = 1.3349, lr_0 = 9.9772e-04
Validation auc = 0.738029
Epoch 3619
Loss = 1.0706e-01, PNorm = 321.3009, GNorm = 5.0380, lr_0 = 9.9772e-04
Loss = 3.0884e-02, PNorm = 321.3458, GNorm = 0.0644, lr_0 = 9.9772e-04
Validation auc = 0.744744
Epoch 3620
Loss = 2.1434e-02, PNorm = 321.3951, GNorm = 0.1823, lr_0 = 9.9772e-04
Validation auc = 0.740845
Epoch 3621
Loss = 5.1072e-02, PNorm = 321.4331, GNorm = 1.0336, lr_0 = 9.9772e-04
Validation auc = 0.739987
Epoch 3622
Loss = 2.2257e-02, PNorm = 321.4773, GNorm = 0.3001, lr_0 = 9.9772e-04
Validation auc = 0.732843
Epoch 3623
Loss = 1.7902e-02, PNorm = 321.5191, GNorm = 0.5229, lr_0 = 9.9772e-04
Validation auc = 0.721159
Epoch 3624
Loss = 1.9024e-02, PNorm = 321.5682, GNorm = 0.0180, lr_0 = 9.9772e-04
Validation auc = 0.716929
Epoch 3625
Loss = 1.3446e-02, PNorm = 321.6225, GNorm = 0.0977, lr_0 = 9.9772e-04
Validation auc = 0.725868
Epoch 3626
Loss = 8.3976e-03, PNorm = 321.6802, GNorm = 0.0695, lr_0 = 9.9772e-04
Validation auc = 0.732822
Epoch 3627
Loss = 1.3337e-01, PNorm = 321.7308, GNorm = 1.6172, lr_0 = 9.9772e-04
Validation auc = 0.731422
Epoch 3628
Loss = 1.0795e-01, PNorm = 321.7903, GNorm = 1.4264, lr_0 = 9.9772e-04
Validation auc = 0.732219
Epoch 3629
Loss = 1.3790e-02, PNorm = 321.8569, GNorm = 0.4515, lr_0 = 9.9771e-04
Loss = 3.8616e-02, PNorm = 321.9169, GNorm = 0.1744, lr_0 = 9.9771e-04
Validation auc = 0.729143
Epoch 3630
Loss = 3.4310e-02, PNorm = 321.9636, GNorm = 0.1587, lr_0 = 9.9771e-04
Validation auc = 0.733843
Epoch 3631
Loss = 3.6402e-02, PNorm = 322.0172, GNorm = 0.8769, lr_0 = 9.9771e-04
Validation auc = 0.730369
Epoch 3632
Loss = 5.2140e-02, PNorm = 322.0883, GNorm = 0.8771, lr_0 = 9.9771e-04
Validation auc = 0.719542
Epoch 3633
Loss = 2.4275e-02, PNorm = 322.1453, GNorm = 0.2419, lr_0 = 9.9771e-04
Validation auc = 0.718914
Epoch 3634
Loss = 1.0337e-02, PNorm = 322.1911, GNorm = 0.1735, lr_0 = 9.9771e-04
Validation auc = 0.726140
Epoch 3635
Loss = 3.5983e-02, PNorm = 322.2231, GNorm = 0.1109, lr_0 = 9.9771e-04
Validation auc = 0.729408
Epoch 3636
Loss = 2.4540e-02, PNorm = 322.2575, GNorm = 1.6842, lr_0 = 9.9771e-04
Validation auc = 0.727972
Epoch 3637
Loss = 1.9116e-02, PNorm = 322.3036, GNorm = 0.8539, lr_0 = 9.9771e-04
Validation auc = 0.724708
Epoch 3638
Loss = 1.7658e-02, PNorm = 322.3484, GNorm = 0.1251, lr_0 = 9.9771e-04
Validation auc = 0.728979
Epoch 3639
Loss = 9.3360e-03, PNorm = 322.3927, GNorm = 0.2492, lr_0 = 9.9771e-04
Loss = 3.7673e-02, PNorm = 322.4356, GNorm = 0.0668, lr_0 = 9.9771e-04
Validation auc = 0.729928
Epoch 3640
Loss = 1.4977e-02, PNorm = 322.4900, GNorm = 0.0490, lr_0 = 9.9771e-04
Validation auc = 0.730512
Epoch 3641
Loss = 3.6425e-02, PNorm = 322.5414, GNorm = 0.8491, lr_0 = 9.9771e-04
Validation auc = 0.730907
Epoch 3642
Loss = 2.5732e-02, PNorm = 322.5959, GNorm = 0.4971, lr_0 = 9.9770e-04
Validation auc = 0.726086
Epoch 3643
Loss = 2.4868e-02, PNorm = 322.6510, GNorm = 0.0362, lr_0 = 9.9770e-04
Validation auc = 0.725199
Epoch 3644
Loss = 3.4938e-02, PNorm = 322.7057, GNorm = 1.4215, lr_0 = 9.9770e-04
Validation auc = 0.724836
Epoch 3645
Loss = 7.9955e-02, PNorm = 322.7648, GNorm = 0.6161, lr_0 = 9.9770e-04
Validation auc = 0.724074
Epoch 3646
Loss = 3.2760e-02, PNorm = 322.8470, GNorm = 1.4837, lr_0 = 9.9770e-04
Validation auc = 0.721373
Epoch 3647
Loss = 2.6408e-02, PNorm = 322.9312, GNorm = 1.5253, lr_0 = 9.9770e-04
Validation auc = 0.721353
Epoch 3648
Loss = 1.7026e-02, PNorm = 323.0050, GNorm = 0.5521, lr_0 = 9.9770e-04
Validation auc = 0.723745
Epoch 3649
Loss = 4.0571e-03, PNorm = 323.0702, GNorm = 0.2075, lr_0 = 9.9770e-04
Loss = 3.5801e-02, PNorm = 323.1250, GNorm = 0.2661, lr_0 = 9.9770e-04
Validation auc = 0.723086
Epoch 3650
Loss = 2.2012e-02, PNorm = 323.1838, GNorm = 0.5447, lr_0 = 9.9770e-04
Validation auc = 0.719309
Epoch 3651
Loss = 2.1447e-02, PNorm = 323.2329, GNorm = 0.0671, lr_0 = 9.9770e-04
Validation auc = 0.716948
Epoch 3652
Loss = 3.5575e-02, PNorm = 323.2740, GNorm = 0.8345, lr_0 = 9.9770e-04
Validation auc = 0.717200
Epoch 3653
Loss = 4.3940e-02, PNorm = 323.3218, GNorm = 1.9935, lr_0 = 9.9770e-04
Validation auc = 0.718501
Epoch 3654
Loss = 2.7049e-02, PNorm = 323.3807, GNorm = 0.3672, lr_0 = 9.9770e-04
Validation auc = 0.729289
Epoch 3655
Loss = 2.6972e-02, PNorm = 323.4295, GNorm = 1.8564, lr_0 = 9.9769e-04
Validation auc = 0.722555
Epoch 3656
Loss = 6.4720e-02, PNorm = 323.4774, GNorm = 0.4582, lr_0 = 9.9769e-04
Validation auc = 0.724390
Epoch 3657
Loss = 7.2775e-03, PNorm = 323.5242, GNorm = 0.0342, lr_0 = 9.9769e-04
Validation auc = 0.714790
Epoch 3658
Loss = 1.4168e-02, PNorm = 323.5664, GNorm = 0.0995, lr_0 = 9.9769e-04
Validation auc = 0.709013
Epoch 3659
Loss = 8.3748e-03, PNorm = 323.6097, GNorm = 0.2809, lr_0 = 9.9769e-04
Loss = 2.6229e-02, PNorm = 323.6477, GNorm = 0.1452, lr_0 = 9.9769e-04
Validation auc = 0.706614
Epoch 3660
Loss = 2.9356e-02, PNorm = 323.6785, GNorm = 0.2117, lr_0 = 9.9769e-04
Validation auc = 0.711335
Epoch 3661
Loss = 1.9637e-02, PNorm = 323.7146, GNorm = 0.0994, lr_0 = 9.9769e-04
Validation auc = 0.721186
Epoch 3662
Loss = 4.0906e-02, PNorm = 323.7536, GNorm = 1.2944, lr_0 = 9.9769e-04
Validation auc = 0.723754
Epoch 3663
Loss = 4.6179e-02, PNorm = 323.7913, GNorm = 0.1047, lr_0 = 9.9769e-04
Validation auc = 0.725198
Epoch 3664
Loss = 7.4404e-03, PNorm = 323.8334, GNorm = 0.2493, lr_0 = 9.9769e-04
Validation auc = 0.722422
Epoch 3665
Loss = 6.4160e-03, PNorm = 323.8617, GNorm = 0.5256, lr_0 = 9.9769e-04
Validation auc = 0.718328
Epoch 3666
Loss = 9.3358e-03, PNorm = 323.8853, GNorm = 0.0389, lr_0 = 9.9769e-04
Validation auc = 0.718158
Epoch 3667
Loss = 1.3357e-02, PNorm = 323.9106, GNorm = 1.7800, lr_0 = 9.9769e-04
Validation auc = 0.717083
Epoch 3668
Loss = 1.1215e-02, PNorm = 323.9387, GNorm = 0.1909, lr_0 = 9.9769e-04
Validation auc = 0.711655
Epoch 3669
Loss = 1.3157e-03, PNorm = 323.9714, GNorm = 0.0450, lr_0 = 9.9768e-04
Loss = 4.1978e-02, PNorm = 324.0025, GNorm = 0.9284, lr_0 = 9.9768e-04
Validation auc = 0.714090
Epoch 3670
Loss = 3.4988e-02, PNorm = 324.0450, GNorm = 1.1703, lr_0 = 9.9768e-04
Validation auc = 0.711171
Epoch 3671
Loss = 1.7348e-02, PNorm = 324.0896, GNorm = 0.4051, lr_0 = 9.9768e-04
Validation auc = 0.708606
Epoch 3672
Loss = 1.8747e-02, PNorm = 324.1254, GNorm = 1.6639, lr_0 = 9.9768e-04
Validation auc = 0.702327
Epoch 3673
Loss = 1.8264e-02, PNorm = 324.1577, GNorm = 0.0442, lr_0 = 9.9768e-04
Validation auc = 0.700004
Epoch 3674
Loss = 1.2793e-02, PNorm = 324.1842, GNorm = 0.1729, lr_0 = 9.9768e-04
Validation auc = 0.696907
Epoch 3675
Loss = 1.0544e-02, PNorm = 324.2041, GNorm = 0.2843, lr_0 = 9.9768e-04
Validation auc = 0.697001
Epoch 3676
Loss = 1.3819e-02, PNorm = 324.2375, GNorm = 0.8484, lr_0 = 9.9768e-04
Validation auc = 0.698940
Epoch 3677
Loss = 3.3479e-02, PNorm = 324.2907, GNorm = 1.1727, lr_0 = 9.9768e-04
Validation auc = 0.705394
Epoch 3678
Loss = 8.3747e-03, PNorm = 324.3428, GNorm = 0.7537, lr_0 = 9.9768e-04
Validation auc = 0.707468
Epoch 3679
Loss = 5.9219e-02, PNorm = 324.3937, GNorm = 0.8999, lr_0 = 9.9768e-04
Loss = 1.7372e-02, PNorm = 324.4407, GNorm = 1.4674, lr_0 = 9.9768e-04
Validation auc = 0.700194
Epoch 3680
Loss = 3.9390e-02, PNorm = 324.4841, GNorm = 0.3591, lr_0 = 9.9768e-04
Validation auc = 0.695349
Epoch 3681
Loss = 4.0049e-02, PNorm = 324.5326, GNorm = 0.1858, lr_0 = 9.9767e-04
Validation auc = 0.699959
Epoch 3682
Loss = 1.3559e-02, PNorm = 324.5798, GNorm = 0.2179, lr_0 = 9.9767e-04
Validation auc = 0.704041
Epoch 3683
Loss = 2.9503e-02, PNorm = 324.6192, GNorm = 0.3032, lr_0 = 9.9767e-04
Validation auc = 0.701404
Epoch 3684
Loss = 4.2794e-02, PNorm = 324.6524, GNorm = 3.7774, lr_0 = 9.9767e-04
Validation auc = 0.707268
Epoch 3685
Loss = 3.9362e-02, PNorm = 324.6891, GNorm = 0.5133, lr_0 = 9.9767e-04
Validation auc = 0.703558
Epoch 3686
Loss = 1.2527e-02, PNorm = 324.7272, GNorm = 0.1413, lr_0 = 9.9767e-04
Validation auc = 0.699277
Epoch 3687
Loss = 3.4264e-02, PNorm = 324.7654, GNorm = 0.2304, lr_0 = 9.9767e-04
Validation auc = 0.696698
Epoch 3688
Loss = 4.6820e-03, PNorm = 324.8050, GNorm = 0.1638, lr_0 = 9.9767e-04
Validation auc = 0.696216
Epoch 3689
Loss = 1.1656e-03, PNorm = 324.8390, GNorm = 0.0414, lr_0 = 9.9767e-04
Loss = 2.0307e-02, PNorm = 324.8819, GNorm = 1.1589, lr_0 = 9.9767e-04
Validation auc = 0.693524
Epoch 3690
Loss = 1.1669e-01, PNorm = 324.9159, GNorm = 8.4832, lr_0 = 9.9767e-04
Validation auc = 0.691059
Epoch 3691
Loss = 5.2303e-02, PNorm = 324.9572, GNorm = 1.4519, lr_0 = 9.9767e-04
Validation auc = 0.667310
Epoch 3692
Loss = 1.2494e-02, PNorm = 325.0042, GNorm = 0.7114, lr_0 = 9.9767e-04
Validation auc = 0.658127
Epoch 3693
Loss = 2.0813e-02, PNorm = 325.0444, GNorm = 0.8848, lr_0 = 9.9767e-04
Validation auc = 0.652067
Epoch 3694
Loss = 2.6422e-02, PNorm = 325.0989, GNorm = 1.6114, lr_0 = 9.9767e-04
Validation auc = 0.666603
Epoch 3695
Loss = 1.0845e-02, PNorm = 325.1551, GNorm = 0.2534, lr_0 = 9.9766e-04
Validation auc = 0.676207
Epoch 3696
Loss = 2.2227e-02, PNorm = 325.2052, GNorm = 1.3763, lr_0 = 9.9766e-04
Validation auc = 0.682972
Epoch 3697
Loss = 2.9948e-02, PNorm = 325.2526, GNorm = 0.9994, lr_0 = 9.9766e-04
Validation auc = 0.687568
Epoch 3698
Loss = 2.4646e-03, PNorm = 325.2887, GNorm = 0.0702, lr_0 = 9.9766e-04
Validation auc = 0.689852
Epoch 3699
Loss = 4.8164e-03, PNorm = 325.3119, GNorm = 0.1968, lr_0 = 9.9766e-04
Loss = 5.5171e-02, PNorm = 325.3366, GNorm = 0.0566, lr_0 = 9.9766e-04
Validation auc = 0.690270
Epoch 3700
Loss = 8.9175e-02, PNorm = 325.3867, GNorm = 6.3453, lr_0 = 9.9766e-04
Validation auc = 0.682314
Epoch 3701
Loss = 2.4392e-02, PNorm = 325.4674, GNorm = 0.6945, lr_0 = 9.9766e-04
Validation auc = 0.688558
Epoch 3702
Loss = 2.9422e-02, PNorm = 325.5552, GNorm = 0.1264, lr_0 = 9.9766e-04
Validation auc = 0.700667
Epoch 3703
Loss = 2.5813e-02, PNorm = 325.6318, GNorm = 0.1357, lr_0 = 9.9766e-04
Validation auc = 0.694192
Epoch 3704
Loss = 6.1617e-02, PNorm = 325.6916, GNorm = 0.0657, lr_0 = 9.9766e-04
Validation auc = 0.695467
Epoch 3705
Loss = 7.4792e-02, PNorm = 325.7468, GNorm = 0.0877, lr_0 = 9.9766e-04
Validation auc = 0.695572
Epoch 3706
Loss = 4.3501e-02, PNorm = 325.7933, GNorm = 2.3299, lr_0 = 9.9766e-04
Validation auc = 0.693814
Epoch 3707
Loss = 2.7064e-02, PNorm = 325.8381, GNorm = 1.1204, lr_0 = 9.9766e-04
Validation auc = 0.697654
Epoch 3708
Loss = 9.4415e-03, PNorm = 325.8734, GNorm = 0.1973, lr_0 = 9.9765e-04
Validation auc = 0.696706
Epoch 3709
Loss = 3.4430e-02, PNorm = 325.9008, GNorm = 0.9874, lr_0 = 9.9765e-04
Loss = 1.7270e-02, PNorm = 325.9358, GNorm = 0.1522, lr_0 = 9.9765e-04
Validation auc = 0.690703
Epoch 3710
Loss = 2.6656e-02, PNorm = 325.9702, GNorm = 1.5742, lr_0 = 9.9765e-04
Validation auc = 0.689353
Epoch 3711
Loss = 1.2332e-02, PNorm = 326.0135, GNorm = 0.0682, lr_0 = 9.9765e-04
Validation auc = 0.689767
Epoch 3712
Loss = 2.8446e-02, PNorm = 326.0576, GNorm = 1.0122, lr_0 = 9.9765e-04
Validation auc = 0.700603
Epoch 3713
Loss = 2.7594e-02, PNorm = 326.1066, GNorm = 0.1012, lr_0 = 9.9765e-04
Validation auc = 0.702422
Epoch 3714
Loss = 1.3021e-02, PNorm = 326.1413, GNorm = 0.0673, lr_0 = 9.9765e-04
Validation auc = 0.703466
Epoch 3715
Loss = 2.9604e-02, PNorm = 326.1754, GNorm = 0.9339, lr_0 = 9.9765e-04
Validation auc = 0.702018
Epoch 3716
Loss = 2.4775e-02, PNorm = 326.2131, GNorm = 0.1755, lr_0 = 9.9765e-04
Validation auc = 0.708480
Epoch 3717
Loss = 4.9110e-02, PNorm = 326.2701, GNorm = 0.8445, lr_0 = 9.9765e-04
Validation auc = 0.705956
Epoch 3718
Loss = 4.6661e-03, PNorm = 326.3262, GNorm = 0.1055, lr_0 = 9.9765e-04
Validation auc = 0.704487
Epoch 3719
Loss = 6.0182e-03, PNorm = 326.3688, GNorm = 0.2107, lr_0 = 9.9765e-04
Loss = 1.6149e-02, PNorm = 326.3984, GNorm = 0.1337, lr_0 = 9.9765e-04
Validation auc = 0.699177
Epoch 3720
Loss = 1.2952e-02, PNorm = 326.4260, GNorm = 0.0428, lr_0 = 9.9765e-04
Validation auc = 0.697945
Epoch 3721
Loss = 5.1018e-02, PNorm = 326.4622, GNorm = 1.8700, lr_0 = 9.9764e-04
Validation auc = 0.694594
Epoch 3722
Loss = 1.5222e-02, PNorm = 326.5168, GNorm = 0.1124, lr_0 = 9.9764e-04
Validation auc = 0.692460
Epoch 3723
Loss = 2.1639e-02, PNorm = 326.5637, GNorm = 0.0176, lr_0 = 9.9764e-04
Validation auc = 0.695462
Epoch 3724
Loss = 3.7779e-02, PNorm = 326.6045, GNorm = 1.6187, lr_0 = 9.9764e-04
Validation auc = 0.704418
Epoch 3725
Loss = 5.5518e-02, PNorm = 326.6491, GNorm = 2.9779, lr_0 = 9.9764e-04
Validation auc = 0.698880
Epoch 3726
Loss = 1.1725e-01, PNorm = 326.7038, GNorm = 1.7854, lr_0 = 9.9764e-04
Validation auc = 0.699977
Epoch 3727
Loss = 8.3105e-03, PNorm = 326.7846, GNorm = 0.1616, lr_0 = 9.9764e-04
Validation auc = 0.699665
Epoch 3728
Loss = 2.1969e-02, PNorm = 326.8402, GNorm = 1.5516, lr_0 = 9.9764e-04
Validation auc = 0.700822
Epoch 3729
Loss = 5.6645e-02, PNorm = 326.8829, GNorm = 2.6547, lr_0 = 9.9764e-04
Loss = 1.3535e-02, PNorm = 326.9295, GNorm = 0.0764, lr_0 = 9.9764e-04
Validation auc = 0.700458
Epoch 3730
Loss = 2.8843e-02, PNorm = 326.9700, GNorm = 0.1239, lr_0 = 9.9764e-04
Validation auc = 0.704511
Epoch 3731
Loss = 1.6890e-02, PNorm = 327.0005, GNorm = 0.0301, lr_0 = 9.9764e-04
Validation auc = 0.702057
Epoch 3732
Loss = 7.1575e-03, PNorm = 327.0274, GNorm = 0.0620, lr_0 = 9.9764e-04
Validation auc = 0.702094
Epoch 3733
Loss = 1.2222e-02, PNorm = 327.0510, GNorm = 0.0585, lr_0 = 9.9764e-04
Validation auc = 0.708118
Epoch 3734
Loss = 2.5548e-02, PNorm = 327.0741, GNorm = 0.0110, lr_0 = 9.9763e-04
Validation auc = 0.718307
Epoch 3735
Loss = 1.5252e-02, PNorm = 327.0963, GNorm = 1.0094, lr_0 = 9.9763e-04
Validation auc = 0.720164
Epoch 3736
Loss = 4.1989e-02, PNorm = 327.1249, GNorm = 0.9916, lr_0 = 9.9763e-04
Validation auc = 0.725897
Epoch 3737
Loss = 3.0188e-03, PNorm = 327.1607, GNorm = 0.1974, lr_0 = 9.9763e-04
Validation auc = 0.728659
Epoch 3738
Loss = 7.6225e-03, PNorm = 327.1905, GNorm = 0.5601, lr_0 = 9.9763e-04
Validation auc = 0.725882
Epoch 3739
Loss = 1.5076e-03, PNorm = 327.2201, GNorm = 0.0503, lr_0 = 9.9763e-04
Loss = 1.8049e-02, PNorm = 327.2521, GNorm = 0.2139, lr_0 = 9.9763e-04
Validation auc = 0.715769
Epoch 3740
Loss = 1.3654e-02, PNorm = 327.2811, GNorm = 1.2122, lr_0 = 9.9763e-04
Validation auc = 0.708032
Epoch 3741
Loss = 1.4635e-02, PNorm = 327.3066, GNorm = 0.0723, lr_0 = 9.9763e-04
Validation auc = 0.704436
Epoch 3742
Loss = 1.2438e-03, PNorm = 327.3293, GNorm = 0.0382, lr_0 = 9.9763e-04
Validation auc = 0.703600
Epoch 3743
Loss = 1.3662e-02, PNorm = 327.3497, GNorm = 0.0146, lr_0 = 9.9763e-04
Validation auc = 0.706679
Epoch 3744
Loss = 2.1174e-03, PNorm = 327.3755, GNorm = 0.2135, lr_0 = 9.9763e-04
Validation auc = 0.706831
Epoch 3745
Loss = 1.8090e-02, PNorm = 327.3911, GNorm = 2.4794, lr_0 = 9.9763e-04
Validation auc = 0.713029
Epoch 3746
Loss = 3.5659e-02, PNorm = 327.4151, GNorm = 0.0060, lr_0 = 9.9763e-04
Validation auc = 0.712731
Epoch 3747
Loss = 2.8878e-02, PNorm = 327.4389, GNorm = 0.0238, lr_0 = 9.9763e-04
Validation auc = 0.703325
Epoch 3748
Loss = 2.0298e-03, PNorm = 327.4754, GNorm = 0.1800, lr_0 = 9.9762e-04
Validation auc = 0.700864
Epoch 3749
Loss = 4.2872e-03, PNorm = 327.5048, GNorm = 0.1566, lr_0 = 9.9762e-04
Loss = 8.0494e-03, PNorm = 327.5330, GNorm = 3.0813, lr_0 = 9.9762e-04
Validation auc = 0.706892
Epoch 3750
Loss = 4.4974e-02, PNorm = 327.5711, GNorm = 0.0433, lr_0 = 9.9762e-04
Validation auc = 0.707830
Epoch 3751
Loss = 8.9308e-03, PNorm = 327.6102, GNorm = 0.3995, lr_0 = 9.9762e-04
Validation auc = 0.713677
Epoch 3752
Loss = 1.3141e-02, PNorm = 327.6396, GNorm = 1.5076, lr_0 = 9.9762e-04
Validation auc = 0.709551
Epoch 3753
Loss = 2.1617e-02, PNorm = 327.6714, GNorm = 0.0532, lr_0 = 9.9762e-04
Validation auc = 0.697212
Epoch 3754
Loss = 5.4634e-02, PNorm = 327.7004, GNorm = 0.0768, lr_0 = 9.9762e-04
Validation auc = 0.692731
Epoch 3755
Loss = 4.4856e-02, PNorm = 327.7237, GNorm = 0.1381, lr_0 = 9.9762e-04
Validation auc = 0.698286
Epoch 3756
Loss = 5.8902e-02, PNorm = 327.7669, GNorm = 2.4480, lr_0 = 9.9762e-04
Validation auc = 0.700370
Epoch 3757
Loss = 1.0283e-01, PNorm = 327.8251, GNorm = 2.3262, lr_0 = 9.9762e-04
Validation auc = 0.708955
Epoch 3758
Loss = 4.8044e-03, PNorm = 327.8888, GNorm = 0.2501, lr_0 = 9.9762e-04
Validation auc = 0.703082
Epoch 3759
Loss = 8.9077e-03, PNorm = 327.9392, GNorm = 0.5294, lr_0 = 9.9762e-04
Loss = 1.2855e-02, PNorm = 327.9902, GNorm = 0.0620, lr_0 = 9.9762e-04
Validation auc = 0.694299
Epoch 3760
Loss = 2.0122e-02, PNorm = 328.0273, GNorm = 1.4035, lr_0 = 9.9762e-04
Validation auc = 0.688608
Epoch 3761
Loss = 3.5269e-02, PNorm = 328.0616, GNorm = 2.2329, lr_0 = 9.9761e-04
Validation auc = 0.695108
Epoch 3762
Loss = 8.7348e-03, PNorm = 328.1088, GNorm = 0.0349, lr_0 = 9.9761e-04
Validation auc = 0.698247
Epoch 3763
Loss = 6.9135e-02, PNorm = 328.1435, GNorm = 8.7933, lr_0 = 9.9761e-04
Validation auc = 0.704007
Epoch 3764
Loss = 1.8506e-02, PNorm = 328.2029, GNorm = 0.7161, lr_0 = 9.9761e-04
Validation auc = 0.715387
Epoch 3765
Loss = 1.9079e-02, PNorm = 328.2623, GNorm = 0.3771, lr_0 = 9.9761e-04
Validation auc = 0.719623
Epoch 3766
Loss = 2.4828e-02, PNorm = 328.3066, GNorm = 0.3917, lr_0 = 9.9761e-04
Validation auc = 0.722148
Epoch 3767
Loss = 2.8600e-02, PNorm = 328.3468, GNorm = 0.0312, lr_0 = 9.9761e-04
Validation auc = 0.728682
Epoch 3768
Loss = 4.7960e-02, PNorm = 328.3832, GNorm = 1.3390, lr_0 = 9.9761e-04
Validation auc = 0.731255
Epoch 3769
Loss = 1.4765e-02, PNorm = 328.4270, GNorm = 0.5482, lr_0 = 9.9761e-04
Loss = 1.1024e-02, PNorm = 328.4721, GNorm = 0.1089, lr_0 = 9.9761e-04
Validation auc = 0.727667
Epoch 3770
Loss = 2.4320e-02, PNorm = 328.5071, GNorm = 1.5418, lr_0 = 9.9761e-04
Validation auc = 0.722972
Epoch 3771
Loss = 1.3020e-02, PNorm = 328.5464, GNorm = 0.4417, lr_0 = 9.9761e-04
Validation auc = 0.722233
Epoch 3772
Loss = 4.1265e-02, PNorm = 328.5861, GNorm = 0.3182, lr_0 = 9.9761e-04
Validation auc = 0.733538
Epoch 3773
Loss = 2.9482e-02, PNorm = 328.6430, GNorm = 0.6848, lr_0 = 9.9761e-04
Validation auc = 0.726179
Epoch 3774
Loss = 4.1385e-02, PNorm = 328.6910, GNorm = 0.0457, lr_0 = 9.9760e-04
Validation auc = 0.713054
Epoch 3775
Loss = 2.0785e-02, PNorm = 328.7338, GNorm = 1.3564, lr_0 = 9.9760e-04
Validation auc = 0.713088
Epoch 3776
Loss = 4.8059e-03, PNorm = 328.7839, GNorm = 0.0349, lr_0 = 9.9760e-04
Validation auc = 0.718029
Epoch 3777
Loss = 1.9191e-02, PNorm = 328.8202, GNorm = 2.1681, lr_0 = 9.9760e-04
Validation auc = 0.715992
Epoch 3778
Loss = 8.1904e-04, PNorm = 328.8584, GNorm = 0.0209, lr_0 = 9.9760e-04
Validation auc = 0.718856
Epoch 3779
Loss = 1.1317e-03, PNorm = 328.8865, GNorm = 0.0526, lr_0 = 9.9760e-04
Loss = 9.5825e-03, PNorm = 328.9160, GNorm = 0.0037, lr_0 = 9.9760e-04
Validation auc = 0.724779
Epoch 3780
Loss = 1.8068e-02, PNorm = 328.9396, GNorm = 0.2468, lr_0 = 9.9760e-04
Validation auc = 0.725203
Epoch 3781
Loss = 2.5251e-02, PNorm = 328.9651, GNorm = 1.8131, lr_0 = 9.9760e-04
Validation auc = 0.721035
Epoch 3782
Loss = 1.2859e-02, PNorm = 328.9884, GNorm = 0.8693, lr_0 = 9.9760e-04
Validation auc = 0.720975
Epoch 3783
Loss = 6.4541e-03, PNorm = 329.0144, GNorm = 0.6311, lr_0 = 9.9760e-04
Validation auc = 0.722628
Epoch 3784
Loss = 3.3236e-02, PNorm = 329.0455, GNorm = 0.1438, lr_0 = 9.9760e-04
Validation auc = 0.736813
Epoch 3785
Loss = 4.9122e-02, PNorm = 329.0795, GNorm = 0.0268, lr_0 = 9.9760e-04
Validation auc = 0.737613
Epoch 3786
Loss = 1.8261e-02, PNorm = 329.1262, GNorm = 1.7623, lr_0 = 9.9760e-04
Validation auc = 0.729722
Epoch 3787
Loss = 5.8021e-02, PNorm = 329.1774, GNorm = 0.2617, lr_0 = 9.9760e-04
Validation auc = 0.728110
Epoch 3788
Loss = 2.6741e-02, PNorm = 329.2395, GNorm = 0.1347, lr_0 = 9.9759e-04
Validation auc = 0.720011
Epoch 3789
Loss = 1.7110e-03, PNorm = 329.3002, GNorm = 0.0547, lr_0 = 9.9759e-04
Loss = 3.7324e-02, PNorm = 329.3505, GNorm = 0.1335, lr_0 = 9.9759e-04
Validation auc = 0.712073
Epoch 3790
Loss = 4.0124e-02, PNorm = 329.4036, GNorm = 0.4288, lr_0 = 9.9759e-04
Validation auc = 0.705867
Epoch 3791
Loss = 2.8084e-02, PNorm = 329.4525, GNorm = 0.2555, lr_0 = 9.9759e-04
Validation auc = 0.702262
Epoch 3792
Loss = 2.4104e-02, PNorm = 329.4940, GNorm = 1.1776, lr_0 = 9.9759e-04
Validation auc = 0.699342
Epoch 3793
Loss = 2.6435e-02, PNorm = 329.5323, GNorm = 1.2522, lr_0 = 9.9759e-04
Validation auc = 0.701269
Epoch 3794
Loss = 1.5181e-02, PNorm = 329.5766, GNorm = 0.1192, lr_0 = 9.9759e-04
Validation auc = 0.703297
Epoch 3795
Loss = 5.8160e-03, PNorm = 329.6185, GNorm = 0.0846, lr_0 = 9.9759e-04
Validation auc = 0.698363
Epoch 3796
Loss = 9.5433e-03, PNorm = 329.6553, GNorm = 0.0206, lr_0 = 9.9759e-04
Validation auc = 0.688541
Epoch 3797
Loss = 2.7158e-02, PNorm = 329.6891, GNorm = 1.2853, lr_0 = 9.9759e-04
Validation auc = 0.688889
Epoch 3798
Loss = 3.3786e-02, PNorm = 329.7278, GNorm = 2.0017, lr_0 = 9.9759e-04
Validation auc = 0.693329
Epoch 3799
Loss = 7.5472e-03, PNorm = 329.7690, GNorm = 0.2776, lr_0 = 9.9759e-04
Loss = 3.6210e-02, PNorm = 329.8174, GNorm = 0.2241, lr_0 = 9.9759e-04
Validation auc = 0.686612
Epoch 3800
Loss = 4.4792e-02, PNorm = 329.8605, GNorm = 0.7293, lr_0 = 9.9758e-04
Validation auc = 0.680137
Epoch 3801
Loss = 1.9150e-02, PNorm = 329.8960, GNorm = 0.1213, lr_0 = 9.9758e-04
Validation auc = 0.682908
Epoch 3802
Loss = 8.1637e-03, PNorm = 329.9298, GNorm = 0.1414, lr_0 = 9.9758e-04
Validation auc = 0.688047
Epoch 3803
Loss = 1.8749e-02, PNorm = 329.9601, GNorm = 0.0997, lr_0 = 9.9758e-04
Validation auc = 0.687231
Epoch 3804
Loss = 2.7041e-02, PNorm = 329.9987, GNorm = 0.0329, lr_0 = 9.9758e-04
Validation auc = 0.695854
Epoch 3805
Loss = 5.3383e-02, PNorm = 330.0525, GNorm = 0.0501, lr_0 = 9.9758e-04
Validation auc = 0.697132
Epoch 3806
Loss = 3.6617e-02, PNorm = 330.1191, GNorm = 0.8841, lr_0 = 9.9758e-04
Validation auc = 0.702083
Epoch 3807
Loss = 3.1141e-02, PNorm = 330.1739, GNorm = 0.1704, lr_0 = 9.9758e-04
Validation auc = 0.704602
Epoch 3808
Loss = 1.4759e-02, PNorm = 330.2228, GNorm = 0.1265, lr_0 = 9.9758e-04
Validation auc = 0.705606
Epoch 3809
Loss = 1.6026e-02, PNorm = 330.2638, GNorm = 0.6128, lr_0 = 9.9758e-04
Loss = 3.0867e-02, PNorm = 330.3016, GNorm = 0.1546, lr_0 = 9.9758e-04
Validation auc = 0.701033
Epoch 3810
Loss = 2.5982e-02, PNorm = 330.3413, GNorm = 0.4721, lr_0 = 9.9758e-04
Validation auc = 0.692358
Epoch 3811
Loss = 2.5704e-02, PNorm = 330.3812, GNorm = 0.1875, lr_0 = 9.9758e-04
Validation auc = 0.682247
Epoch 3812
Loss = 2.9671e-02, PNorm = 330.4160, GNorm = 1.4062, lr_0 = 9.9758e-04
Validation auc = 0.680067
Epoch 3813
Loss = 2.0200e-02, PNorm = 330.4511, GNorm = 1.1850, lr_0 = 9.9758e-04
Validation auc = 0.687492
Epoch 3814
Loss = 4.6845e-02, PNorm = 330.4921, GNorm = 2.5536, lr_0 = 9.9757e-04
Validation auc = 0.678830
Epoch 3815
Loss = 1.6955e-02, PNorm = 330.5345, GNorm = 2.0799, lr_0 = 9.9757e-04
Validation auc = 0.671793
Epoch 3816
Loss = 2.1943e-02, PNorm = 330.5738, GNorm = 1.9068, lr_0 = 9.9757e-04
Validation auc = 0.676523
Epoch 3817
Loss = 1.8005e-02, PNorm = 330.6121, GNorm = 0.1825, lr_0 = 9.9757e-04
Validation auc = 0.674082
Epoch 3818
Loss = 4.3725e-03, PNorm = 330.6481, GNorm = 0.7967, lr_0 = 9.9757e-04
Validation auc = 0.673198
Epoch 3819
Loss = 8.5125e-04, PNorm = 330.6844, GNorm = 0.0283, lr_0 = 9.9757e-04
Loss = 1.7581e-02, PNorm = 330.7130, GNorm = 1.5514, lr_0 = 9.9757e-04
Validation auc = 0.672602
Epoch 3820
Loss = 4.5595e-02, PNorm = 330.7513, GNorm = 1.7379, lr_0 = 9.9757e-04
Validation auc = 0.679699
Epoch 3821
Loss = 2.6668e-02, PNorm = 330.8341, GNorm = 1.1774, lr_0 = 9.9757e-04
Validation auc = 0.679695
Epoch 3822
Loss = 8.3272e-03, PNorm = 330.9108, GNorm = 0.0214, lr_0 = 9.9757e-04
Validation auc = 0.675076
Epoch 3823
Loss = 1.9563e-02, PNorm = 330.9651, GNorm = 0.8800, lr_0 = 9.9757e-04
Validation auc = 0.678011
Epoch 3824
Loss = 2.0524e-02, PNorm = 331.0148, GNorm = 1.8223, lr_0 = 9.9757e-04
Validation auc = 0.686213
Epoch 3825
Loss = 2.1209e-02, PNorm = 331.0655, GNorm = 0.6321, lr_0 = 9.9757e-04
Validation auc = 0.692200
Epoch 3826
Loss = 1.6028e-02, PNorm = 331.1220, GNorm = 0.7394, lr_0 = 9.9757e-04
Validation auc = 0.688373
Epoch 3827
Loss = 2.9278e-02, PNorm = 331.1926, GNorm = 0.1833, lr_0 = 9.9756e-04
Validation auc = 0.692334
Epoch 3828
Loss = 8.2452e-02, PNorm = 331.2656, GNorm = 0.1325, lr_0 = 9.9756e-04
Validation auc = 0.690681
Epoch 3829
Loss = 2.2360e-01, PNorm = 331.3264, GNorm = 7.0546, lr_0 = 9.9756e-04
Loss = 5.6375e-02, PNorm = 331.4095, GNorm = 1.1074, lr_0 = 9.9756e-04
Validation auc = 0.680745
Epoch 3830
Loss = 3.2329e-02, PNorm = 331.4795, GNorm = 0.2093, lr_0 = 9.9756e-04
Validation auc = 0.676446
Epoch 3831
Loss = 3.0828e-02, PNorm = 331.5293, GNorm = 1.1471, lr_0 = 9.9756e-04
Validation auc = 0.676041
Epoch 3832
Loss = 3.1853e-02, PNorm = 331.5738, GNorm = 1.1020, lr_0 = 9.9756e-04
Validation auc = 0.687460
Epoch 3833
Loss = 2.1575e-02, PNorm = 331.6235, GNorm = 0.7527, lr_0 = 9.9756e-04
Validation auc = 0.699237
Epoch 3834
Loss = 1.2213e-02, PNorm = 331.6694, GNorm = 0.0730, lr_0 = 9.9756e-04
Validation auc = 0.701536
Epoch 3835
Loss = 2.2503e-02, PNorm = 331.6992, GNorm = 1.7245, lr_0 = 9.9756e-04
Validation auc = 0.703656
Epoch 3836
Loss = 5.2124e-02, PNorm = 331.7296, GNorm = 2.3078, lr_0 = 9.9756e-04
Validation auc = 0.707035
Epoch 3837
Loss = 2.1399e-02, PNorm = 331.7722, GNorm = 1.0560, lr_0 = 9.9756e-04
Validation auc = 0.712695
Epoch 3838
Loss = 3.5845e-03, PNorm = 331.8084, GNorm = 0.1474, lr_0 = 9.9756e-04
Validation auc = 0.715662
Epoch 3839
Loss = 2.9046e-02, PNorm = 331.8495, GNorm = 1.3585, lr_0 = 9.9756e-04
Loss = 2.7156e-02, PNorm = 331.9040, GNorm = 0.4853, lr_0 = 9.9756e-04
Validation auc = 0.706530
Epoch 3840
Loss = 1.7467e-02, PNorm = 331.9493, GNorm = 1.5578, lr_0 = 9.9755e-04
Validation auc = 0.699343
Epoch 3841
Loss = 7.8201e-02, PNorm = 331.9910, GNorm = 1.6684, lr_0 = 9.9755e-04
Validation auc = 0.690855
Epoch 3842
Loss = 3.3060e-02, PNorm = 332.0454, GNorm = 0.5436, lr_0 = 9.9755e-04
Validation auc = 0.683743
Epoch 3843
Loss = 3.3506e-02, PNorm = 332.0957, GNorm = 0.9837, lr_0 = 9.9755e-04
Validation auc = 0.690545
Epoch 3844
Loss = 2.2255e-02, PNorm = 332.1386, GNorm = 2.0416, lr_0 = 9.9755e-04
Validation auc = 0.683260
Epoch 3845
Loss = 2.7875e-02, PNorm = 332.1795, GNorm = 0.4447, lr_0 = 9.9755e-04
Validation auc = 0.679690
Epoch 3846
Loss = 1.1697e-02, PNorm = 332.2210, GNorm = 0.3737, lr_0 = 9.9755e-04
Validation auc = 0.688536
Epoch 3847
Loss = 2.1901e-02, PNorm = 332.2530, GNorm = 0.4739, lr_0 = 9.9755e-04
Validation auc = 0.689594
Epoch 3848
Loss = 8.4107e-02, PNorm = 332.2863, GNorm = 1.8633, lr_0 = 9.9755e-04
Validation auc = 0.703044
Epoch 3849
Loss = 2.3238e-02, PNorm = 332.3308, GNorm = 0.5161, lr_0 = 9.9755e-04
Loss = 2.7955e-02, PNorm = 332.3794, GNorm = 1.5723, lr_0 = 9.9755e-04
Validation auc = 0.716795
Epoch 3850
Loss = 1.0722e-02, PNorm = 332.4213, GNorm = 0.2926, lr_0 = 9.9755e-04
Validation auc = 0.720570
Epoch 3851
Loss = 9.4889e-03, PNorm = 332.4467, GNorm = 0.0496, lr_0 = 9.9755e-04
Validation auc = 0.721845
Epoch 3852
Loss = 1.1434e-02, PNorm = 332.4731, GNorm = 0.0232, lr_0 = 9.9755e-04
Validation auc = 0.724417
Epoch 3853
Loss = 2.0075e-02, PNorm = 332.4976, GNorm = 1.9650, lr_0 = 9.9754e-04
Validation auc = 0.723826
Epoch 3854
Loss = 5.8038e-02, PNorm = 332.5249, GNorm = 0.3923, lr_0 = 9.9754e-04
Validation auc = 0.731073
Epoch 3855
Loss = 1.7285e-02, PNorm = 332.5563, GNorm = 0.3988, lr_0 = 9.9754e-04
Validation auc = 0.727604
Epoch 3856
Loss = 3.8462e-03, PNorm = 332.5797, GNorm = 0.5627, lr_0 = 9.9754e-04
Validation auc = 0.723332
Epoch 3857
Loss = 1.4912e-02, PNorm = 332.5965, GNorm = 0.6488, lr_0 = 9.9754e-04
Validation auc = 0.718530
Epoch 3858
Loss = 6.6537e-03, PNorm = 332.6276, GNorm = 0.3081, lr_0 = 9.9754e-04
Validation auc = 0.713255
Epoch 3859
Loss = 2.6347e-02, PNorm = 332.6746, GNorm = 1.3169, lr_0 = 9.9754e-04
Loss = 3.6916e-02, PNorm = 332.7164, GNorm = 0.2659, lr_0 = 9.9754e-04
Validation auc = 0.707162
Epoch 3860
Loss = 4.6265e-02, PNorm = 332.7535, GNorm = 0.1382, lr_0 = 9.9754e-04
Validation auc = 0.708311
Epoch 3861
Loss = 4.1288e-02, PNorm = 332.7989, GNorm = 2.8888, lr_0 = 9.9754e-04
Validation auc = 0.707565
Epoch 3862
Loss = 2.9202e-02, PNorm = 332.8476, GNorm = 0.1252, lr_0 = 9.9754e-04
Validation auc = 0.706631
Epoch 3863
Loss = 2.8240e-02, PNorm = 332.8923, GNorm = 0.1703, lr_0 = 9.9754e-04
Validation auc = 0.702064
Epoch 3864
Loss = 4.7397e-02, PNorm = 332.9297, GNorm = 0.8345, lr_0 = 9.9754e-04
Validation auc = 0.697975
Epoch 3865
Loss = 3.5042e-02, PNorm = 332.9795, GNorm = 1.6995, lr_0 = 9.9754e-04
Validation auc = 0.714431
Epoch 3866
Loss = 3.1934e-02, PNorm = 333.0201, GNorm = 1.2043, lr_0 = 9.9754e-04
Validation auc = 0.723263
Epoch 3867
Loss = 4.1558e-03, PNorm = 333.0483, GNorm = 0.0693, lr_0 = 9.9753e-04
Validation auc = 0.721679
Epoch 3868
Loss = 1.9631e-02, PNorm = 333.0779, GNorm = 0.7259, lr_0 = 9.9753e-04
Validation auc = 0.713948
Epoch 3869
Loss = 2.9981e-02, PNorm = 333.1313, GNorm = 1.7102, lr_0 = 9.9753e-04
Loss = 1.6790e-02, PNorm = 333.1780, GNorm = 0.2287, lr_0 = 9.9753e-04
Validation auc = 0.715741
Epoch 3870
Loss = 1.1214e-02, PNorm = 333.2212, GNorm = 0.5728, lr_0 = 9.9753e-04
Validation auc = 0.709360
Epoch 3871
Loss = 2.7129e-02, PNorm = 333.2628, GNorm = 0.1824, lr_0 = 9.9753e-04
Validation auc = 0.702544
Epoch 3872
Loss = 2.5620e-02, PNorm = 333.3069, GNorm = 0.3107, lr_0 = 9.9753e-04
Validation auc = 0.711651
Epoch 3873
Loss = 1.5032e-02, PNorm = 333.3501, GNorm = 0.3871, lr_0 = 9.9753e-04
Validation auc = 0.713099
Epoch 3874
Loss = 6.4977e-02, PNorm = 333.3892, GNorm = 0.6688, lr_0 = 9.9753e-04
Validation auc = 0.706272
Epoch 3875
Loss = 3.8115e-02, PNorm = 333.4387, GNorm = 2.1448, lr_0 = 9.9753e-04
Validation auc = 0.712199
Epoch 3876
Loss = 4.8021e-02, PNorm = 333.4913, GNorm = 0.2828, lr_0 = 9.9753e-04
Validation auc = 0.712164
Epoch 3877
Loss = 6.8499e-03, PNorm = 333.5349, GNorm = 0.5347, lr_0 = 9.9753e-04
Validation auc = 0.711873
Epoch 3878
Loss = 1.1963e-02, PNorm = 333.5824, GNorm = 1.3190, lr_0 = 9.9753e-04
Validation auc = 0.712282
Epoch 3879
Loss = 6.2575e-03, PNorm = 333.6230, GNorm = 0.5255, lr_0 = 9.9753e-04
Loss = 1.5525e-02, PNorm = 333.6580, GNorm = 1.5461, lr_0 = 9.9753e-04
Validation auc = 0.711472
Epoch 3880
Loss = 1.5336e-02, PNorm = 333.6966, GNorm = 0.3513, lr_0 = 9.9752e-04
Validation auc = 0.707620
Epoch 3881
Loss = 6.1674e-02, PNorm = 333.7609, GNorm = 3.6271, lr_0 = 9.9752e-04
Validation auc = 0.696048
Epoch 3882
Loss = 2.3243e-02, PNorm = 333.8421, GNorm = 0.0435, lr_0 = 9.9752e-04
Validation auc = 0.698173
Epoch 3883
Loss = 2.4432e-02, PNorm = 333.9120, GNorm = 0.4762, lr_0 = 9.9752e-04
Validation auc = 0.699256
Epoch 3884
Loss = 2.1498e-02, PNorm = 333.9703, GNorm = 1.0157, lr_0 = 9.9752e-04
Validation auc = 0.697697
Epoch 3885
Loss = 2.6455e-02, PNorm = 334.0127, GNorm = 0.2809, lr_0 = 9.9752e-04
Validation auc = 0.709971
Epoch 3886
Loss = 5.8667e-02, PNorm = 334.0564, GNorm = 0.1756, lr_0 = 9.9752e-04
Validation auc = 0.715700
Epoch 3887
Loss = 1.1592e-02, PNorm = 334.0984, GNorm = 0.6649, lr_0 = 9.9752e-04
Validation auc = 0.719363
Epoch 3888
Loss = 3.5535e-02, PNorm = 334.1341, GNorm = 1.1680, lr_0 = 9.9752e-04
Validation auc = 0.723229
Epoch 3889
Loss = 3.1538e-04, PNorm = 334.1704, GNorm = 0.0267, lr_0 = 9.9752e-04
Loss = 2.1957e-02, PNorm = 334.1999, GNorm = 0.2715, lr_0 = 9.9752e-04
Validation auc = 0.724694
Epoch 3890
Loss = 9.1020e-03, PNorm = 334.2286, GNorm = 0.7647, lr_0 = 9.9752e-04
Validation auc = 0.721305
Epoch 3891
Loss = 1.4027e-02, PNorm = 334.2647, GNorm = 0.6886, lr_0 = 9.9752e-04
Validation auc = 0.715671
Epoch 3892
Loss = 2.2648e-02, PNorm = 334.3055, GNorm = 0.1221, lr_0 = 9.9752e-04
Validation auc = 0.716210
Epoch 3893
Loss = 2.0984e-03, PNorm = 334.3369, GNorm = 0.5477, lr_0 = 9.9751e-04
Validation auc = 0.718930
Epoch 3894
Loss = 6.0580e-03, PNorm = 334.3566, GNorm = 0.2205, lr_0 = 9.9751e-04
Validation auc = 0.717832
Epoch 3895
Loss = 1.6130e-02, PNorm = 334.3835, GNorm = 0.9936, lr_0 = 9.9751e-04
Validation auc = 0.703885
Epoch 3896
Loss = 8.6007e-02, PNorm = 334.4152, GNorm = 1.3343, lr_0 = 9.9751e-04
Validation auc = 0.693802
Epoch 3897
Loss = 3.7381e-02, PNorm = 334.4619, GNorm = 1.4280, lr_0 = 9.9751e-04
Validation auc = 0.691108
Epoch 3898
Loss = 2.1509e-02, PNorm = 334.5020, GNorm = 2.3462, lr_0 = 9.9751e-04
Validation auc = 0.689376
Epoch 3899
Loss = 8.0098e-03, PNorm = 334.5419, GNorm = 0.3064, lr_0 = 9.9751e-04
Loss = 2.3146e-02, PNorm = 334.5749, GNorm = 1.2259, lr_0 = 9.9751e-04
Validation auc = 0.686444
Epoch 3900
Loss = 4.4164e-02, PNorm = 334.6185, GNorm = 0.5224, lr_0 = 9.9751e-04
Validation auc = 0.686100
Epoch 3901
Loss = 9.9152e-03, PNorm = 334.6575, GNorm = 1.5132, lr_0 = 9.9751e-04
Validation auc = 0.686470
Epoch 3902
Loss = 1.1967e-02, PNorm = 334.6961, GNorm = 0.6979, lr_0 = 9.9751e-04
Validation auc = 0.685572
Epoch 3903
Loss = 5.1873e-02, PNorm = 334.7300, GNorm = 1.3960, lr_0 = 9.9751e-04
Validation auc = 0.690676
Epoch 3904
Loss = 1.2220e-02, PNorm = 334.7682, GNorm = 0.0346, lr_0 = 9.9751e-04
Validation auc = 0.705326
Epoch 3905
Loss = 1.9436e-02, PNorm = 334.7990, GNorm = 0.3469, lr_0 = 9.9751e-04
Validation auc = 0.711971
Epoch 3906
Loss = 1.8631e-02, PNorm = 334.8257, GNorm = 2.7866, lr_0 = 9.9751e-04
Validation auc = 0.705983
Epoch 3907
Loss = 6.6014e-03, PNorm = 334.8559, GNorm = 0.0957, lr_0 = 9.9750e-04
Validation auc = 0.705257
Epoch 3908
Loss = 3.2433e-02, PNorm = 334.8781, GNorm = 1.0008, lr_0 = 9.9750e-04
Validation auc = 0.707190
Epoch 3909
Loss = 1.0396e-02, PNorm = 334.9099, GNorm = 0.5028, lr_0 = 9.9750e-04
Loss = 1.7103e-02, PNorm = 334.9388, GNorm = 0.2543, lr_0 = 9.9750e-04
Validation auc = 0.709945
Epoch 3910
Loss = 2.1060e-02, PNorm = 334.9640, GNorm = 0.0246, lr_0 = 9.9750e-04
Validation auc = 0.705427
Epoch 3911
Loss = 1.6118e-02, PNorm = 334.9911, GNorm = 1.6038, lr_0 = 9.9750e-04
Validation auc = 0.702661
Epoch 3912
Loss = 2.4551e-02, PNorm = 335.0257, GNorm = 0.4256, lr_0 = 9.9750e-04
Validation auc = 0.700872
Epoch 3913
Loss = 1.5187e-02, PNorm = 335.0596, GNorm = 0.7973, lr_0 = 9.9750e-04
Validation auc = 0.697095
Epoch 3914
Loss = 6.7486e-02, PNorm = 335.0862, GNorm = 1.7125, lr_0 = 9.9750e-04
Validation auc = 0.699841
Epoch 3915
Loss = 1.1665e-01, PNorm = 335.1336, GNorm = 1.1647, lr_0 = 9.9750e-04
Validation auc = 0.701420
Epoch 3916
Loss = 2.6238e-02, PNorm = 335.2089, GNorm = 0.2130, lr_0 = 9.9750e-04
Validation auc = 0.697329
Epoch 3917
Loss = 3.3211e-02, PNorm = 335.2715, GNorm = 1.2313, lr_0 = 9.9750e-04
Validation auc = 0.692422
Epoch 3918
Loss = 6.6397e-03, PNorm = 335.3150, GNorm = 0.2325, lr_0 = 9.9750e-04
Validation auc = 0.691412
Epoch 3919
Loss = 3.7096e-03, PNorm = 335.3547, GNorm = 0.4211, lr_0 = 9.9750e-04
Loss = 2.7241e-02, PNorm = 335.3885, GNorm = 1.4581, lr_0 = 9.9749e-04
Validation auc = 0.697051
Epoch 3920
Loss = 2.9802e-02, PNorm = 335.4276, GNorm = 0.4462, lr_0 = 9.9749e-04
Validation auc = 0.705690
Epoch 3921
Loss = 6.1480e-02, PNorm = 335.4666, GNorm = 3.2994, lr_0 = 9.9749e-04
Validation auc = 0.714948
Epoch 3922
Loss = 3.4051e-02, PNorm = 335.5134, GNorm = 0.0468, lr_0 = 9.9749e-04
Validation auc = 0.725073
Epoch 3923
Loss = 3.5149e-02, PNorm = 335.5666, GNorm = 1.4734, lr_0 = 9.9749e-04
Validation auc = 0.726575
Epoch 3924
Loss = 1.3024e-02, PNorm = 335.6142, GNorm = 0.3076, lr_0 = 9.9749e-04
Validation auc = 0.726531
Epoch 3925
Loss = 4.3279e-02, PNorm = 335.6503, GNorm = 4.2823, lr_0 = 9.9749e-04
Validation auc = 0.729231
Epoch 3926
Loss = 1.0978e-02, PNorm = 335.6849, GNorm = 0.6838, lr_0 = 9.9749e-04
Validation auc = 0.728992
Epoch 3927
Loss = 1.0026e-02, PNorm = 335.7200, GNorm = 0.2885, lr_0 = 9.9749e-04
Validation auc = 0.720193
Epoch 3928
Loss = 2.6405e-02, PNorm = 335.7605, GNorm = 0.0599, lr_0 = 9.9749e-04
Validation auc = 0.708828
Epoch 3929
Loss = 2.4993e-02, PNorm = 335.8192, GNorm = 1.0579, lr_0 = 9.9749e-04
Loss = 1.8927e-02, PNorm = 335.8758, GNorm = 1.9718, lr_0 = 9.9749e-04
Validation auc = 0.707876
Epoch 3930
Loss = 4.6274e-02, PNorm = 335.9287, GNorm = 0.9035, lr_0 = 9.9749e-04
Validation auc = 0.719864
Epoch 3931
Loss = 2.5120e-02, PNorm = 335.9788, GNorm = 0.1020, lr_0 = 9.9749e-04
Validation auc = 0.716733
Epoch 3932
Loss = 1.5990e-02, PNorm = 336.0281, GNorm = 0.2911, lr_0 = 9.9749e-04
Validation auc = 0.713370
Epoch 3933
Loss = 3.3066e-02, PNorm = 336.0769, GNorm = 0.6671, lr_0 = 9.9748e-04
Validation auc = 0.713065
Epoch 3934
Loss = 2.2986e-02, PNorm = 336.1176, GNorm = 0.1173, lr_0 = 9.9748e-04
Validation auc = 0.714626
Epoch 3935
Loss = 4.4341e-02, PNorm = 336.1692, GNorm = 0.1871, lr_0 = 9.9748e-04
Validation auc = 0.706365
Epoch 3936
Loss = 4.1715e-02, PNorm = 336.2315, GNorm = 0.8808, lr_0 = 9.9748e-04
Validation auc = 0.698910
Epoch 3937
Loss = 1.0828e-02, PNorm = 336.2971, GNorm = 1.0601, lr_0 = 9.9748e-04
Validation auc = 0.696363
Epoch 3938
Loss = 1.2687e-03, PNorm = 336.3411, GNorm = 0.0623, lr_0 = 9.9748e-04
Validation auc = 0.700768
Epoch 3939
Loss = 1.3694e-03, PNorm = 336.3706, GNorm = 0.0663, lr_0 = 9.9748e-04
Loss = 1.2102e-02, PNorm = 336.4070, GNorm = 0.0368, lr_0 = 9.9748e-04
Validation auc = 0.708917
Epoch 3940
Loss = 1.4402e-02, PNorm = 336.4410, GNorm = 0.2885, lr_0 = 9.9748e-04
Validation auc = 0.710298
Epoch 3941
Loss = 3.2570e-02, PNorm = 336.4678, GNorm = 0.2083, lr_0 = 9.9748e-04
Validation auc = 0.706025
Epoch 3942
Loss = 3.3478e-02, PNorm = 336.5014, GNorm = 0.9653, lr_0 = 9.9748e-04
Validation auc = 0.702602
Epoch 3943
Loss = 5.2315e-02, PNorm = 336.5505, GNorm = 0.5680, lr_0 = 9.9748e-04
Validation auc = 0.712302
Epoch 3944
Loss = 1.2186e-02, PNorm = 336.5942, GNorm = 0.2637, lr_0 = 9.9748e-04
Validation auc = 0.723608
Epoch 3945
Loss = 1.0882e-02, PNorm = 336.6264, GNorm = 0.8225, lr_0 = 9.9748e-04
Validation auc = 0.722591
Epoch 3946
Loss = 8.7820e-02, PNorm = 336.6526, GNorm = 3.2182, lr_0 = 9.9747e-04
Validation auc = 0.722256
Epoch 3947
Loss = 4.2520e-02, PNorm = 336.6799, GNorm = 0.3593, lr_0 = 9.9747e-04
Validation auc = 0.719436
Epoch 3948
Loss = 4.5045e-03, PNorm = 336.7134, GNorm = 0.0953, lr_0 = 9.9747e-04
Validation auc = 0.717807
Epoch 3949
Loss = 4.3160e-03, PNorm = 336.7461, GNorm = 0.1444, lr_0 = 9.9747e-04
Loss = 2.2784e-02, PNorm = 336.7910, GNorm = 3.5677, lr_0 = 9.9747e-04
Validation auc = 0.711715
Epoch 3950
Loss = 2.8289e-02, PNorm = 336.8487, GNorm = 0.0240, lr_0 = 9.9747e-04
Validation auc = 0.717134
Epoch 3951
Loss = 3.9918e-02, PNorm = 336.9010, GNorm = 2.8231, lr_0 = 9.9747e-04
Validation auc = 0.724409
Epoch 3952
Loss = 3.6349e-02, PNorm = 336.9594, GNorm = 2.3879, lr_0 = 9.9747e-04
Validation auc = 0.721182
Epoch 3953
Loss = 2.6680e-02, PNorm = 337.0197, GNorm = 0.8555, lr_0 = 9.9747e-04
Validation auc = 0.715009
Epoch 3954
Loss = 4.0198e-02, PNorm = 337.0653, GNorm = 3.5483, lr_0 = 9.9747e-04
Validation auc = 0.714364
Epoch 3955
Loss = 4.4291e-03, PNorm = 337.1114, GNorm = 0.2095, lr_0 = 9.9747e-04
Validation auc = 0.707235
Epoch 3956
Loss = 1.6593e-02, PNorm = 337.1528, GNorm = 0.0296, lr_0 = 9.9747e-04
Validation auc = 0.701760
Epoch 3957
Loss = 6.6098e-03, PNorm = 337.1981, GNorm = 0.5691, lr_0 = 9.9747e-04
Validation auc = 0.692808
Epoch 3958
Loss = 1.3953e-02, PNorm = 337.2435, GNorm = 0.3937, lr_0 = 9.9747e-04
Validation auc = 0.688047
Epoch 3959
Loss = 1.0663e-03, PNorm = 337.2859, GNorm = 0.0462, lr_0 = 9.9747e-04
Loss = 3.0013e-02, PNorm = 337.3211, GNorm = 0.9682, lr_0 = 9.9746e-04
Validation auc = 0.679943
Epoch 3960
Loss = 6.3720e-03, PNorm = 337.3516, GNorm = 1.0870, lr_0 = 9.9746e-04
Validation auc = 0.677872
Epoch 3961
Loss = 1.7451e-02, PNorm = 337.3837, GNorm = 0.1485, lr_0 = 9.9746e-04
Validation auc = 0.683661
Epoch 3962
Loss = 4.8267e-03, PNorm = 337.4167, GNorm = 0.0509, lr_0 = 9.9746e-04
Validation auc = 0.689682
Epoch 3963
Loss = 4.7899e-02, PNorm = 337.4494, GNorm = 0.0252, lr_0 = 9.9746e-04
Validation auc = 0.686364
Epoch 3964
Loss = 4.4050e-02, PNorm = 337.4803, GNorm = 0.1475, lr_0 = 9.9746e-04
Validation auc = 0.690344
Epoch 3965
Loss = 3.9177e-02, PNorm = 337.5229, GNorm = 0.8655, lr_0 = 9.9746e-04
Validation auc = 0.700701
Epoch 3966
Loss = 9.3261e-03, PNorm = 337.5784, GNorm = 0.0614, lr_0 = 9.9746e-04
Validation auc = 0.698084
Epoch 3967
Loss = 4.7655e-03, PNorm = 337.6234, GNorm = 0.0922, lr_0 = 9.9746e-04
Validation auc = 0.697050
Epoch 3968
Loss = 4.4402e-02, PNorm = 337.6657, GNorm = 1.8531, lr_0 = 9.9746e-04
Validation auc = 0.696288
Epoch 3969
Loss = 1.2031e-01, PNorm = 337.7213, GNorm = 3.6848, lr_0 = 9.9746e-04
Loss = 3.6252e-02, PNorm = 337.7884, GNorm = 0.9805, lr_0 = 9.9746e-04
Validation auc = 0.692832
Epoch 3970
Loss = 4.4287e-02, PNorm = 337.8457, GNorm = 0.4597, lr_0 = 9.9746e-04
Validation auc = 0.692207
Epoch 3971
Loss = 3.8224e-02, PNorm = 337.8980, GNorm = 0.2352, lr_0 = 9.9746e-04
Validation auc = 0.687041
Epoch 3972
Loss = 4.3049e-02, PNorm = 337.9446, GNorm = 1.0248, lr_0 = 9.9746e-04
Validation auc = 0.695531
Epoch 3973
Loss = 2.1076e-02, PNorm = 337.9849, GNorm = 0.0257, lr_0 = 9.9745e-04
Validation auc = 0.682316
Epoch 3974
Loss = 2.3641e-02, PNorm = 338.0240, GNorm = 3.2176, lr_0 = 9.9745e-04
Validation auc = 0.674668
Epoch 3975
Loss = 8.6921e-02, PNorm = 338.0784, GNorm = 1.9908, lr_0 = 9.9745e-04
Validation auc = 0.672155
Epoch 3976
Loss = 2.8786e-02, PNorm = 338.1495, GNorm = 4.2911, lr_0 = 9.9745e-04
Validation auc = 0.672995
Epoch 3977
Loss = 4.1351e-02, PNorm = 338.2208, GNorm = 1.4483, lr_0 = 9.9745e-04
Validation auc = 0.673872
Epoch 3978
Loss = 9.3535e-02, PNorm = 338.2788, GNorm = 4.0156, lr_0 = 9.9745e-04
Validation auc = 0.682376
Epoch 3979
Loss = 2.7335e-03, PNorm = 338.3397, GNorm = 0.4321, lr_0 = 9.9745e-04
Loss = 2.6136e-02, PNorm = 338.3932, GNorm = 0.1390, lr_0 = 9.9745e-04
Validation auc = 0.688951
Epoch 3980
Loss = 2.4597e-02, PNorm = 338.4363, GNorm = 0.2840, lr_0 = 9.9745e-04
Validation auc = 0.685950
Epoch 3981
Loss = 1.3392e-02, PNorm = 338.4785, GNorm = 0.3878, lr_0 = 9.9745e-04
Validation auc = 0.682745
Epoch 3982
Loss = 2.8515e-02, PNorm = 338.5204, GNorm = 0.4370, lr_0 = 9.9745e-04
Validation auc = 0.687555
Epoch 3983
Loss = 4.4025e-02, PNorm = 338.5708, GNorm = 1.4556, lr_0 = 9.9745e-04
Validation auc = 0.696087
Epoch 3984
Loss = 4.7184e-02, PNorm = 338.6298, GNorm = 0.4439, lr_0 = 9.9745e-04
Validation auc = 0.697263
Epoch 3985
Loss = 4.7983e-02, PNorm = 338.6809, GNorm = 0.0593, lr_0 = 9.9745e-04
Validation auc = 0.688101
Epoch 3986
Loss = 2.0311e-02, PNorm = 338.7361, GNorm = 0.1010, lr_0 = 9.9744e-04
Validation auc = 0.687132
Epoch 3987
Loss = 2.0695e-02, PNorm = 338.7844, GNorm = 1.2692, lr_0 = 9.9744e-04
Validation auc = 0.695650
Epoch 3988
Loss = 7.4639e-03, PNorm = 338.8237, GNorm = 0.2821, lr_0 = 9.9744e-04
Validation auc = 0.699752
Epoch 3989
Loss = 7.0414e-03, PNorm = 338.8614, GNorm = 0.2338, lr_0 = 9.9744e-04
Loss = 4.0720e-02, PNorm = 338.9080, GNorm = 1.6707, lr_0 = 9.9744e-04
Validation auc = 0.702169
Epoch 3990
Loss = 9.0213e-03, PNorm = 338.9490, GNorm = 0.2443, lr_0 = 9.9744e-04
Validation auc = 0.699129
Epoch 3991
Loss = 4.3762e-02, PNorm = 338.9826, GNorm = 0.1387, lr_0 = 9.9744e-04
Validation auc = 0.699065
Epoch 3992
Loss = 1.8288e-02, PNorm = 339.0177, GNorm = 0.6303, lr_0 = 9.9744e-04
Validation auc = 0.705542
Epoch 3993
Loss = 2.8501e-03, PNorm = 339.0504, GNorm = 0.0375, lr_0 = 9.9744e-04
Validation auc = 0.708385
Epoch 3994
Loss = 7.3468e-03, PNorm = 339.0743, GNorm = 0.1298, lr_0 = 9.9744e-04
Validation auc = 0.704494
Epoch 3995
Loss = 5.3148e-02, PNorm = 339.1005, GNorm = 0.3058, lr_0 = 9.9744e-04
Validation auc = 0.705546
Epoch 3996
Loss = 8.7302e-03, PNorm = 339.1435, GNorm = 0.1561, lr_0 = 9.9744e-04
Validation auc = 0.708056
Epoch 3997
Loss = 3.3041e-02, PNorm = 339.1767, GNorm = 0.1625, lr_0 = 9.9744e-04
Validation auc = 0.705465
Epoch 3998
Loss = 5.7597e-02, PNorm = 339.2119, GNorm = 0.4362, lr_0 = 9.9744e-04
Validation auc = 0.699747
Epoch 3999
Loss = 1.7064e-02, PNorm = 339.2561, GNorm = 0.4121, lr_0 = 9.9744e-04
Loss = 3.0595e-02, PNorm = 339.2958, GNorm = 1.1395, lr_0 = 9.9743e-04
Validation auc = 0.695871
Epoch 4000
Loss = 3.3488e-02, PNorm = 339.3461, GNorm = 1.1613, lr_0 = 9.9743e-04
Validation auc = 0.691581
Epoch 4001
Loss = 2.6939e-02, PNorm = 339.4005, GNorm = 0.1749, lr_0 = 9.9743e-04
Validation auc = 0.700633
Epoch 4002
Loss = 2.1466e-02, PNorm = 339.4507, GNorm = 1.6468, lr_0 = 9.9743e-04
Validation auc = 0.704591
Epoch 4003
Loss = 1.1213e-02, PNorm = 339.4884, GNorm = 0.0456, lr_0 = 9.9743e-04
Validation auc = 0.706732
Epoch 4004
Loss = 2.2183e-02, PNorm = 339.5167, GNorm = 1.3241, lr_0 = 9.9743e-04
Validation auc = 0.710294
Epoch 4005
Loss = 2.3074e-02, PNorm = 339.5654, GNorm = 0.3351, lr_0 = 9.9743e-04
Validation auc = 0.716326
Epoch 4006
Loss = 1.1080e-02, PNorm = 339.6275, GNorm = 0.2899, lr_0 = 9.9743e-04
Validation auc = 0.720205
Epoch 4007
Loss = 1.4100e-01, PNorm = 339.6779, GNorm = 2.0574, lr_0 = 9.9743e-04
Validation auc = 0.706374
Epoch 4008
Loss = 5.2494e-02, PNorm = 339.7434, GNorm = 1.3613, lr_0 = 9.9743e-04
Validation auc = 0.702656
Epoch 4009
Loss = 8.8291e-03, PNorm = 339.8075, GNorm = 0.2768, lr_0 = 9.9743e-04
Loss = 8.7277e-03, PNorm = 339.8525, GNorm = 0.0992, lr_0 = 9.9743e-04
Validation auc = 0.705267
Epoch 4010
Loss = 3.2469e-02, PNorm = 339.8884, GNorm = 0.9687, lr_0 = 9.9743e-04
Validation auc = 0.702525
Epoch 4011
Loss = 4.4643e-02, PNorm = 339.9216, GNorm = 1.6531, lr_0 = 9.9743e-04
Validation auc = 0.699473
Epoch 4012
Loss = 1.0560e-02, PNorm = 339.9587, GNorm = 0.1337, lr_0 = 9.9742e-04
Validation auc = 0.701803
Epoch 4013
Loss = 5.0371e-03, PNorm = 339.9848, GNorm = 0.5775, lr_0 = 9.9742e-04
Validation auc = 0.702702
Epoch 4014
Loss = 9.9362e-03, PNorm = 340.0060, GNorm = 0.0505, lr_0 = 9.9742e-04
Validation auc = 0.703907
Epoch 4015
Loss = 5.4363e-03, PNorm = 340.0323, GNorm = 0.1574, lr_0 = 9.9742e-04
Validation auc = 0.707630
Epoch 4016
Loss = 4.3045e-03, PNorm = 340.0699, GNorm = 0.1966, lr_0 = 9.9742e-04
Validation auc = 0.708900
Epoch 4017
Loss = 2.3922e-02, PNorm = 340.0979, GNorm = 1.4781, lr_0 = 9.9742e-04
Validation auc = 0.712224
Epoch 4018
Loss = 1.3457e-02, PNorm = 340.1222, GNorm = 1.0779, lr_0 = 9.9742e-04
Validation auc = 0.715948
Epoch 4019
Loss = 2.8653e-02, PNorm = 340.1474, GNorm = 1.2492, lr_0 = 9.9742e-04
Loss = 2.2069e-02, PNorm = 340.1724, GNorm = 0.0857, lr_0 = 9.9742e-04
Validation auc = 0.720645
Epoch 4020
Loss = 1.1713e-02, PNorm = 340.1974, GNorm = 0.7424, lr_0 = 9.9742e-04
Validation auc = 0.721412
Epoch 4021
Loss = 3.8098e-02, PNorm = 340.2217, GNorm = 2.3354, lr_0 = 9.9742e-04
Validation auc = 0.712772
Epoch 4022
Loss = 3.3291e-02, PNorm = 340.2651, GNorm = 0.2440, lr_0 = 9.9742e-04
Validation auc = 0.705513
Epoch 4023
Loss = 4.7627e-02, PNorm = 340.3242, GNorm = 0.1608, lr_0 = 9.9742e-04
Validation auc = 0.710498
Epoch 4024
Loss = 2.0733e-02, PNorm = 340.3862, GNorm = 0.1311, lr_0 = 9.9742e-04
Validation auc = 0.711611
Epoch 4025
Loss = 2.4672e-02, PNorm = 340.4378, GNorm = 0.2766, lr_0 = 9.9742e-04
Validation auc = 0.716053
Epoch 4026
Loss = 6.6280e-02, PNorm = 340.4859, GNorm = 3.0505, lr_0 = 9.9741e-04
Validation auc = 0.704204
Epoch 4027
Loss = 1.3728e-02, PNorm = 340.5380, GNorm = 0.2967, lr_0 = 9.9741e-04
Validation auc = 0.706265
Epoch 4028
Loss = 2.1420e-02, PNorm = 340.5757, GNorm = 2.6138, lr_0 = 9.9741e-04
Validation auc = 0.706487
Epoch 4029
Loss = 1.1395e-02, PNorm = 340.6089, GNorm = 0.4963, lr_0 = 9.9741e-04
Loss = 2.6235e-02, PNorm = 340.6431, GNorm = 0.1062, lr_0 = 9.9741e-04
Validation auc = 0.702185
Epoch 4030
Loss = 2.2460e-02, PNorm = 340.6829, GNorm = 0.2323, lr_0 = 9.9741e-04
Validation auc = 0.702457
Epoch 4031
Loss = 2.4418e-02, PNorm = 340.7197, GNorm = 0.0787, lr_0 = 9.9741e-04
Validation auc = 0.704497
Epoch 4032
Loss = 6.1900e-03, PNorm = 340.7541, GNorm = 0.0900, lr_0 = 9.9741e-04
Validation auc = 0.700652
Epoch 4033
Loss = 3.3837e-02, PNorm = 340.7796, GNorm = 0.6956, lr_0 = 9.9741e-04
Validation auc = 0.700464
Epoch 4034
Loss = 2.4374e-02, PNorm = 340.8027, GNorm = 0.1996, lr_0 = 9.9741e-04
Validation auc = 0.700276
Epoch 4035
Loss = 2.9757e-02, PNorm = 340.8251, GNorm = 2.2602, lr_0 = 9.9741e-04
Validation auc = 0.700016
Epoch 4036
Loss = 1.5118e-02, PNorm = 340.8589, GNorm = 0.0699, lr_0 = 9.9741e-04
Validation auc = 0.695360
Epoch 4037
Loss = 2.0968e-03, PNorm = 340.8851, GNorm = 0.0468, lr_0 = 9.9741e-04
Validation auc = 0.694528
Epoch 4038
Loss = 1.3604e-01, PNorm = 340.9037, GNorm = 0.1668, lr_0 = 9.9741e-04
Validation auc = 0.697743
Epoch 4039
Loss = 1.1568e-02, PNorm = 340.9386, GNorm = 0.3683, lr_0 = 9.9740e-04
Loss = 2.4330e-02, PNorm = 340.9816, GNorm = 1.7945, lr_0 = 9.9740e-04
Validation auc = 0.701108
Epoch 4040
Loss = 3.8233e-02, PNorm = 341.0134, GNorm = 0.0894, lr_0 = 9.9740e-04
Validation auc = 0.695044
Epoch 4041
Loss = 1.8683e-02, PNorm = 341.0402, GNorm = 0.1298, lr_0 = 9.9740e-04
Validation auc = 0.698621
Epoch 4042
Loss = 1.8901e-02, PNorm = 341.0756, GNorm = 0.0915, lr_0 = 9.9740e-04
Validation auc = 0.699759
Epoch 4043
Loss = 1.4608e-02, PNorm = 341.1039, GNorm = 1.6364, lr_0 = 9.9740e-04
Validation auc = 0.702125
Epoch 4044
Loss = 6.2802e-03, PNorm = 341.1295, GNorm = 0.3788, lr_0 = 9.9740e-04
Validation auc = 0.702792
Epoch 4045
Loss = 6.8163e-03, PNorm = 341.1506, GNorm = 0.7351, lr_0 = 9.9740e-04
Validation auc = 0.699765
Epoch 4046
Loss = 3.5361e-02, PNorm = 341.1733, GNorm = 0.1072, lr_0 = 9.9740e-04
Validation auc = 0.695427
Epoch 4047
Loss = 3.8470e-03, PNorm = 341.2030, GNorm = 0.1568, lr_0 = 9.9740e-04
Validation auc = 0.694929
Epoch 4048
Loss = 3.5968e-02, PNorm = 341.2266, GNorm = 1.4076, lr_0 = 9.9740e-04
Validation auc = 0.694261
Epoch 4049
Loss = 3.1358e-03, PNorm = 341.2552, GNorm = 0.1774, lr_0 = 9.9740e-04
Loss = 7.4847e-03, PNorm = 341.2813, GNorm = 0.7296, lr_0 = 9.9740e-04
Validation auc = 0.690883
Epoch 4050
Loss = 2.5394e-02, PNorm = 341.3084, GNorm = 0.9251, lr_0 = 9.9740e-04
Validation auc = 0.689987
Epoch 4051
Loss = 4.0184e-02, PNorm = 341.3515, GNorm = 0.0424, lr_0 = 9.9740e-04
Validation auc = 0.697445
Epoch 4052
Loss = 2.7124e-02, PNorm = 341.3968, GNorm = 0.5386, lr_0 = 9.9739e-04
Validation auc = 0.699808
Epoch 4053
Loss = 5.6255e-02, PNorm = 341.4443, GNorm = 2.3231, lr_0 = 9.9739e-04
Validation auc = 0.702800
Epoch 4054
Loss = 4.0571e-02, PNorm = 341.5178, GNorm = 1.8797, lr_0 = 9.9739e-04
Validation auc = 0.697463
Epoch 4055
Loss = 4.9644e-02, PNorm = 341.6034, GNorm = 0.1944, lr_0 = 9.9739e-04
Validation auc = 0.696505
Epoch 4056
Loss = 4.1008e-02, PNorm = 341.6774, GNorm = 0.3397, lr_0 = 9.9739e-04
Validation auc = 0.695870
Epoch 4057
Loss = 5.7277e-03, PNorm = 341.7271, GNorm = 0.4507, lr_0 = 9.9739e-04
Validation auc = 0.695526
Epoch 4058
Loss = 2.7911e-02, PNorm = 341.7621, GNorm = 0.7760, lr_0 = 9.9739e-04
Validation auc = 0.688549
Epoch 4059
Loss = 1.3847e-03, PNorm = 341.7959, GNorm = 0.0563, lr_0 = 9.9739e-04
Loss = 1.0766e-01, PNorm = 341.8339, GNorm = 0.3300, lr_0 = 9.9739e-04
Validation auc = 0.688992
Epoch 4060
Loss = 1.3045e-02, PNorm = 341.8862, GNorm = 0.3249, lr_0 = 9.9739e-04
Validation auc = 0.713448
Epoch 4061
Loss = 3.0757e-02, PNorm = 341.9265, GNorm = 0.1754, lr_0 = 9.9739e-04
Validation auc = 0.708551
Epoch 4062
Loss = 1.5479e-02, PNorm = 341.9591, GNorm = 2.4919, lr_0 = 9.9739e-04
Validation auc = 0.703671
Epoch 4063
Loss = 1.4480e-02, PNorm = 341.9868, GNorm = 0.0543, lr_0 = 9.9739e-04
Validation auc = 0.699698
Epoch 4064
Loss = 2.2069e-02, PNorm = 342.0141, GNorm = 1.9272, lr_0 = 9.9739e-04
Validation auc = 0.698795
Epoch 4065
Loss = 9.8032e-02, PNorm = 342.0430, GNorm = 2.9889, lr_0 = 9.9738e-04
Validation auc = 0.691977
Epoch 4066
Loss = 2.0553e-02, PNorm = 342.0762, GNorm = 1.4387, lr_0 = 9.9738e-04
Validation auc = 0.685226
Epoch 4067
Loss = 3.5021e-02, PNorm = 342.1164, GNorm = 1.4275, lr_0 = 9.9738e-04
Validation auc = 0.691928
Epoch 4068
Loss = 6.8868e-03, PNorm = 342.1687, GNorm = 0.1744, lr_0 = 9.9738e-04
Validation auc = 0.697093
Epoch 4069
Loss = 9.5059e-02, PNorm = 342.2092, GNorm = 2.1509, lr_0 = 9.9738e-04
Loss = 1.1356e-02, PNorm = 342.2447, GNorm = 0.1568, lr_0 = 9.9738e-04
Validation auc = 0.700584
Epoch 4070
Loss = 1.2720e-02, PNorm = 342.2785, GNorm = 0.1855, lr_0 = 9.9738e-04
Validation auc = 0.704427
Epoch 4071
Loss = 4.6952e-02, PNorm = 342.3177, GNorm = 1.2307, lr_0 = 9.9738e-04
Validation auc = 0.698858
Epoch 4072
Loss = 1.2812e-02, PNorm = 342.3590, GNorm = 0.9349, lr_0 = 9.9738e-04
Validation auc = 0.695995
Epoch 4073
Loss = 7.8357e-03, PNorm = 342.3995, GNorm = 1.1171, lr_0 = 9.9738e-04
Validation auc = 0.688431
Epoch 4074
Loss = 6.0113e-02, PNorm = 342.4524, GNorm = 2.1859, lr_0 = 9.9738e-04
Validation auc = 0.689284
Epoch 4075
Loss = 2.5030e-02, PNorm = 342.5062, GNorm = 0.2914, lr_0 = 9.9738e-04
Validation auc = 0.694446
Epoch 4076
Loss = 1.7066e-02, PNorm = 342.5508, GNorm = 0.8657, lr_0 = 9.9738e-04
Validation auc = 0.692725
Epoch 4077
Loss = 2.7742e-02, PNorm = 342.5813, GNorm = 0.1545, lr_0 = 9.9738e-04
Validation auc = 0.691687
Epoch 4078
Loss = 1.1164e-02, PNorm = 342.6059, GNorm = 0.8089, lr_0 = 9.9738e-04
Validation auc = 0.691768
Epoch 4079
Loss = 5.9889e-02, PNorm = 342.6308, GNorm = 1.8757, lr_0 = 9.9737e-04
Loss = 3.9713e-02, PNorm = 342.6768, GNorm = 0.4597, lr_0 = 9.9737e-04
Validation auc = 0.697666
Epoch 4080
Loss = 2.9892e-02, PNorm = 342.7293, GNorm = 0.3208, lr_0 = 9.9737e-04
Validation auc = 0.699260
Epoch 4081
Loss = 3.4017e-02, PNorm = 342.7646, GNorm = 0.8877, lr_0 = 9.9737e-04
Validation auc = 0.697346
Epoch 4082
Loss = 2.2365e-02, PNorm = 342.7955, GNorm = 0.1037, lr_0 = 9.9737e-04
Validation auc = 0.699980
Epoch 4083
Loss = 3.1498e-02, PNorm = 342.8225, GNorm = 2.0465, lr_0 = 9.9737e-04
Validation auc = 0.704956
Epoch 4084
Loss = 1.1158e-02, PNorm = 342.8556, GNorm = 0.1238, lr_0 = 9.9737e-04
Validation auc = 0.709782
Epoch 4085
Loss = 2.0700e-03, PNorm = 342.8858, GNorm = 0.2173, lr_0 = 9.9737e-04
Validation auc = 0.710450
Epoch 4086
Loss = 7.7250e-03, PNorm = 342.9039, GNorm = 0.2552, lr_0 = 9.9737e-04
Validation auc = 0.711366
Epoch 4087
Loss = 8.1412e-03, PNorm = 342.9194, GNorm = 0.1486, lr_0 = 9.9737e-04
Validation auc = 0.706302
Epoch 4088
Loss = 5.1029e-04, PNorm = 342.9348, GNorm = 0.0264, lr_0 = 9.9737e-04
Validation auc = 0.704806
Epoch 4089
Loss = 2.3085e-04, PNorm = 342.9485, GNorm = 0.0242, lr_0 = 9.9737e-04
Loss = 2.7872e-02, PNorm = 342.9650, GNorm = 1.2688, lr_0 = 9.9737e-04
Validation auc = 0.702293
Epoch 4090
Loss = 4.2959e-02, PNorm = 342.9976, GNorm = 0.1433, lr_0 = 9.9737e-04
Validation auc = 0.706057
Epoch 4091
Loss = 1.3712e-02, PNorm = 343.0583, GNorm = 0.8647, lr_0 = 9.9737e-04
Validation auc = 0.710782
Epoch 4092
Loss = 1.2196e-02, PNorm = 343.1014, GNorm = 1.6328, lr_0 = 9.9736e-04
Validation auc = 0.710210
Epoch 4093
Loss = 3.6554e-02, PNorm = 343.1409, GNorm = 0.0692, lr_0 = 9.9736e-04
Validation auc = 0.716179
Epoch 4094
Loss = 1.2237e-02, PNorm = 343.1857, GNorm = 0.9889, lr_0 = 9.9736e-04
Validation auc = 0.714297
Epoch 4095
Loss = 5.2993e-02, PNorm = 343.2189, GNorm = 0.2161, lr_0 = 9.9736e-04
Validation auc = 0.717883
Epoch 4096
Loss = 2.7338e-02, PNorm = 343.2537, GNorm = 0.0220, lr_0 = 9.9736e-04
Validation auc = 0.722512
Epoch 4097
Loss = 1.8749e-02, PNorm = 343.2844, GNorm = 0.9635, lr_0 = 9.9736e-04
Validation auc = 0.716669
Epoch 4098
Loss = 5.3861e-02, PNorm = 343.3125, GNorm = 1.4815, lr_0 = 9.9736e-04
Validation auc = 0.712582
Epoch 4099
Loss = 2.5570e-03, PNorm = 343.3347, GNorm = 0.1823, lr_0 = 9.9736e-04
Loss = 5.7378e-02, PNorm = 343.3622, GNorm = 2.1065, lr_0 = 9.9736e-04
Validation auc = 0.712894
Epoch 4100
Loss = 1.2742e-02, PNorm = 343.4044, GNorm = 0.3293, lr_0 = 9.9736e-04
Validation auc = 0.712521
Epoch 4101
Loss = 2.7873e-02, PNorm = 343.4452, GNorm = 0.1393, lr_0 = 9.9736e-04
Validation auc = 0.713864
Epoch 4102
Loss = 3.4121e-02, PNorm = 343.4851, GNorm = 0.2041, lr_0 = 9.9736e-04
Validation auc = 0.718353
Epoch 4103
Loss = 4.4167e-03, PNorm = 343.5229, GNorm = 0.0387, lr_0 = 9.9736e-04
Validation auc = 0.725301
Epoch 4104
Loss = 6.1705e-03, PNorm = 343.5518, GNorm = 0.4215, lr_0 = 9.9736e-04
Validation auc = 0.725140
Epoch 4105
Loss = 3.5602e-02, PNorm = 343.5823, GNorm = 0.3425, lr_0 = 9.9735e-04
Validation auc = 0.714458
Epoch 4106
Loss = 5.8732e-02, PNorm = 343.6136, GNorm = 0.0959, lr_0 = 9.9735e-04
Validation auc = 0.709532
Epoch 4107
Loss = 5.0901e-02, PNorm = 343.6554, GNorm = 0.2342, lr_0 = 9.9735e-04
Validation auc = 0.709402
Epoch 4108
Loss = 7.0781e-03, PNorm = 343.7053, GNorm = 0.7931, lr_0 = 9.9735e-04
Validation auc = 0.710847
Epoch 4109
Loss = 2.0416e-02, PNorm = 343.7443, GNorm = 0.8718, lr_0 = 9.9735e-04
Loss = 5.8190e-02, PNorm = 343.8033, GNorm = 0.2458, lr_0 = 9.9735e-04
Validation auc = 0.705482
Epoch 4110
Loss = 3.0401e-02, PNorm = 343.8610, GNorm = 0.2099, lr_0 = 9.9735e-04
Validation auc = 0.705968
Epoch 4111
Loss = 3.3183e-02, PNorm = 343.9123, GNorm = 1.2067, lr_0 = 9.9735e-04
Validation auc = 0.699379
Epoch 4112
Loss = 2.9990e-02, PNorm = 343.9627, GNorm = 0.1907, lr_0 = 9.9735e-04
Validation auc = 0.695543
Epoch 4113
Loss = 8.8573e-03, PNorm = 344.0024, GNorm = 0.4890, lr_0 = 9.9735e-04
Validation auc = 0.697588
Epoch 4114
Loss = 4.7954e-03, PNorm = 344.0252, GNorm = 0.1503, lr_0 = 9.9735e-04
Validation auc = 0.698304
Epoch 4115
Loss = 1.1778e-02, PNorm = 344.0467, GNorm = 0.6791, lr_0 = 9.9735e-04
Validation auc = 0.700478
Epoch 4116
Loss = 1.5010e-02, PNorm = 344.0675, GNorm = 0.0641, lr_0 = 9.9735e-04
Validation auc = 0.706218
Epoch 4117
Loss = 2.2649e-02, PNorm = 344.0990, GNorm = 0.0648, lr_0 = 9.9735e-04
Validation auc = 0.708243
Epoch 4118
Loss = 3.9795e-02, PNorm = 344.1304, GNorm = 0.1132, lr_0 = 9.9735e-04
Validation auc = 0.704813
Epoch 4119
Loss = 3.5501e-03, PNorm = 344.1621, GNorm = 0.1298, lr_0 = 9.9734e-04
Loss = 1.4174e-02, PNorm = 344.1907, GNorm = 0.3091, lr_0 = 9.9734e-04
Validation auc = 0.706381
Epoch 4120
Loss = 1.5609e-02, PNorm = 344.2145, GNorm = 0.9304, lr_0 = 9.9734e-04
Validation auc = 0.710038
Epoch 4121
Loss = 3.5428e-02, PNorm = 344.2386, GNorm = 2.2706, lr_0 = 9.9734e-04
Validation auc = 0.719477
Epoch 4122
Loss = 1.6535e-02, PNorm = 344.2720, GNorm = 1.2566, lr_0 = 9.9734e-04
Validation auc = 0.720716
Epoch 4123
Loss = 1.0423e-02, PNorm = 344.3035, GNorm = 1.4805, lr_0 = 9.9734e-04
Validation auc = 0.718628
Epoch 4124
Loss = 1.2729e-02, PNorm = 344.3298, GNorm = 0.0375, lr_0 = 9.9734e-04
Validation auc = 0.711360
Epoch 4125
Loss = 3.6827e-02, PNorm = 344.3613, GNorm = 1.9493, lr_0 = 9.9734e-04
Validation auc = 0.704301
Epoch 4126
Loss = 5.1391e-03, PNorm = 344.3942, GNorm = 0.1302, lr_0 = 9.9734e-04
Validation auc = 0.703349
Epoch 4127
Loss = 2.0779e-02, PNorm = 344.4228, GNorm = 1.3511, lr_0 = 9.9734e-04
Validation auc = 0.704634
Epoch 4128
Loss = 1.3985e-03, PNorm = 344.4514, GNorm = 0.0190, lr_0 = 9.9734e-04
Validation auc = 0.703754
Epoch 4129
Loss = 1.4741e-02, PNorm = 344.4766, GNorm = 0.7554, lr_0 = 9.9734e-04
Loss = 2.2680e-02, PNorm = 344.5115, GNorm = 0.0495, lr_0 = 9.9734e-04
Validation auc = 0.697854
Epoch 4130
Loss = 2.2931e-02, PNorm = 344.5415, GNorm = 0.0350, lr_0 = 9.9734e-04
Validation auc = 0.695261
Epoch 4131
Loss = 2.2552e-02, PNorm = 344.5738, GNorm = 0.0770, lr_0 = 9.9733e-04
Validation auc = 0.693463
Epoch 4132
Loss = 1.1334e-02, PNorm = 344.6083, GNorm = 0.1781, lr_0 = 9.9733e-04
Validation auc = 0.697508
Epoch 4133
Loss = 4.6465e-02, PNorm = 344.6492, GNorm = 0.0587, lr_0 = 9.9733e-04
Validation auc = 0.687789
Epoch 4134
Loss = 2.8600e-02, PNorm = 344.6989, GNorm = 2.2124, lr_0 = 9.9733e-04
Validation auc = 0.693357
Epoch 4135
Loss = 1.5367e-02, PNorm = 344.7551, GNorm = 0.2028, lr_0 = 9.9733e-04
Validation auc = 0.704344
Epoch 4136
Loss = 1.6863e-02, PNorm = 344.8126, GNorm = 0.9350, lr_0 = 9.9733e-04
Validation auc = 0.704410
Epoch 4137
Loss = 8.6538e-02, PNorm = 344.8663, GNorm = 0.1887, lr_0 = 9.9733e-04
Validation auc = 0.699560
Epoch 4138
Loss = 1.3506e-02, PNorm = 344.9093, GNorm = 0.0967, lr_0 = 9.9733e-04
Validation auc = 0.698373
Epoch 4139
Loss = 1.0322e-02, PNorm = 344.9497, GNorm = 0.5452, lr_0 = 9.9733e-04
Loss = 2.1980e-02, PNorm = 344.9893, GNorm = 0.4244, lr_0 = 9.9733e-04
Validation auc = 0.689268
Epoch 4140
Loss = 5.5157e-02, PNorm = 345.0350, GNorm = 1.7013, lr_0 = 9.9733e-04
Validation auc = 0.693523
Epoch 4141
Loss = 3.4962e-02, PNorm = 345.0840, GNorm = 0.5461, lr_0 = 9.9733e-04
Validation auc = 0.701256
Epoch 4142
Loss = 4.9394e-02, PNorm = 345.1238, GNorm = 0.9678, lr_0 = 9.9733e-04
Validation auc = 0.708097
Epoch 4143
Loss = 1.6439e-02, PNorm = 345.1602, GNorm = 0.1322, lr_0 = 9.9733e-04
Validation auc = 0.711961
Epoch 4144
Loss = 1.4035e-02, PNorm = 345.1899, GNorm = 0.8770, lr_0 = 9.9733e-04
Validation auc = 0.717930
Epoch 4145
Loss = 8.0613e-03, PNorm = 345.2256, GNorm = 0.0839, lr_0 = 9.9732e-04
Validation auc = 0.718603
Epoch 4146
Loss = 1.1998e-02, PNorm = 345.2591, GNorm = 1.4258, lr_0 = 9.9732e-04
Validation auc = 0.721309
Epoch 4147
Loss = 3.0176e-02, PNorm = 345.2925, GNorm = 0.0485, lr_0 = 9.9732e-04
Validation auc = 0.725285
Epoch 4148
Loss = 4.3315e-03, PNorm = 345.3364, GNorm = 0.3590, lr_0 = 9.9732e-04
Validation auc = 0.725135
Epoch 4149
Loss = 7.2897e-03, PNorm = 345.3843, GNorm = 0.2768, lr_0 = 9.9732e-04
Loss = 2.4915e-02, PNorm = 345.4504, GNorm = 0.0845, lr_0 = 9.9732e-04
Validation auc = 0.719196
Epoch 4150
Loss = 3.2130e-02, PNorm = 345.5220, GNorm = 0.7654, lr_0 = 9.9732e-04
Validation auc = 0.717302
Epoch 4151
Loss = 3.9053e-02, PNorm = 345.5739, GNorm = 0.1174, lr_0 = 9.9732e-04
Validation auc = 0.722520
Epoch 4152
Loss = 2.9470e-02, PNorm = 345.6311, GNorm = 1.1388, lr_0 = 9.9732e-04
Validation auc = 0.724634
Epoch 4153
Loss = 1.4137e-02, PNorm = 345.6838, GNorm = 0.1228, lr_0 = 9.9732e-04
Validation auc = 0.721429
Epoch 4154
Loss = 2.5337e-02, PNorm = 345.7225, GNorm = 1.1291, lr_0 = 9.9732e-04
Validation auc = 0.714757
Epoch 4155
Loss = 1.3193e-02, PNorm = 345.7632, GNorm = 0.8285, lr_0 = 9.9732e-04
Validation auc = 0.711518
Epoch 4156
Loss = 1.4192e-02, PNorm = 345.7953, GNorm = 0.2100, lr_0 = 9.9732e-04
Validation auc = 0.716712
Epoch 4157
Loss = 2.4027e-02, PNorm = 345.8242, GNorm = 0.1181, lr_0 = 9.9732e-04
Validation auc = 0.720784
Epoch 4158
Loss = 2.1715e-02, PNorm = 345.8577, GNorm = 0.0549, lr_0 = 9.9731e-04
Validation auc = 0.722635
Epoch 4159
Loss = 4.9230e-03, PNorm = 345.8846, GNorm = 0.1760, lr_0 = 9.9731e-04
Loss = 2.5175e-02, PNorm = 345.9197, GNorm = 0.1868, lr_0 = 9.9731e-04
Validation auc = 0.716916
Epoch 4160
Loss = 6.2066e-02, PNorm = 345.9718, GNorm = 0.1257, lr_0 = 9.9731e-04
Validation auc = 0.706322
Epoch 4161
Loss = 7.9591e-02, PNorm = 346.0176, GNorm = 0.6972, lr_0 = 9.9731e-04
Validation auc = 0.710586
Epoch 4162
Loss = 3.9033e-02, PNorm = 346.0685, GNorm = 0.3682, lr_0 = 9.9731e-04
Validation auc = 0.707249
Epoch 4163
Loss = 4.7792e-02, PNorm = 346.1222, GNorm = 0.1681, lr_0 = 9.9731e-04
Validation auc = 0.706261
Epoch 4164
Loss = 3.2573e-02, PNorm = 346.1776, GNorm = 0.1299, lr_0 = 9.9731e-04
Validation auc = 0.710581
Epoch 4165
Loss = 3.6731e-02, PNorm = 346.2250, GNorm = 1.7568, lr_0 = 9.9731e-04
Validation auc = 0.714654
Epoch 4166
Loss = 3.2664e-02, PNorm = 346.2671, GNorm = 1.3387, lr_0 = 9.9731e-04
Validation auc = 0.718376
Epoch 4167
Loss = 8.9584e-02, PNorm = 346.3075, GNorm = 4.9150, lr_0 = 9.9731e-04
Validation auc = 0.724298
Epoch 4168
Loss = 8.7097e-03, PNorm = 346.3578, GNorm = 0.5218, lr_0 = 9.9731e-04
Validation auc = 0.719504
Epoch 4169
Loss = 2.4896e-02, PNorm = 346.4077, GNorm = 1.0648, lr_0 = 9.9731e-04
Loss = 3.4419e-02, PNorm = 346.4477, GNorm = 0.1658, lr_0 = 9.9731e-04
Validation auc = 0.715438
Epoch 4170
Loss = 3.3199e-02, PNorm = 346.4845, GNorm = 1.4117, lr_0 = 9.9731e-04
Validation auc = 0.725689
Epoch 4171
Loss = 2.2752e-02, PNorm = 346.5223, GNorm = 0.4623, lr_0 = 9.9730e-04
Validation auc = 0.730681
Epoch 4172
Loss = 3.6892e-02, PNorm = 346.5570, GNorm = 0.7534, lr_0 = 9.9730e-04
Validation auc = 0.732235
Epoch 4173
Loss = 2.8995e-02, PNorm = 346.6015, GNorm = 1.0654, lr_0 = 9.9730e-04
Validation auc = 0.734152
Epoch 4174
Loss = 1.2084e-02, PNorm = 346.6484, GNorm = 0.3461, lr_0 = 9.9730e-04
Validation auc = 0.736048
Epoch 4175
Loss = 6.5339e-02, PNorm = 346.6840, GNorm = 5.0637, lr_0 = 9.9730e-04
Validation auc = 0.736215
Epoch 4176
Loss = 4.9390e-03, PNorm = 346.7219, GNorm = 0.1127, lr_0 = 9.9730e-04
Validation auc = 0.734058
Epoch 4177
Loss = 5.1726e-03, PNorm = 346.7601, GNorm = 0.0483, lr_0 = 9.9730e-04
Validation auc = 0.731855
Epoch 4178
Loss = 2.8714e-03, PNorm = 346.7955, GNorm = 0.1750, lr_0 = 9.9730e-04
Validation auc = 0.732808
Epoch 4179
Loss = 3.9367e-02, PNorm = 346.8281, GNorm = 1.1461, lr_0 = 9.9730e-04
Loss = 3.0268e-02, PNorm = 346.8635, GNorm = 0.1895, lr_0 = 9.9730e-04
Validation auc = 0.738865
Epoch 4180
Loss = 1.4787e-02, PNorm = 346.9043, GNorm = 0.1778, lr_0 = 9.9730e-04
Validation auc = 0.743969
Epoch 4181
Loss = 2.2471e-02, PNorm = 346.9402, GNorm = 2.3063, lr_0 = 9.9730e-04
Validation auc = 0.746008
Epoch 4182
Loss = 3.2154e-02, PNorm = 346.9793, GNorm = 1.0160, lr_0 = 9.9730e-04
Validation auc = 0.745849
Epoch 4183
Loss = 5.0244e-03, PNorm = 347.0429, GNorm = 0.2275, lr_0 = 9.9730e-04
Validation auc = 0.741102
Epoch 4184
Loss = 6.7309e-02, PNorm = 347.0931, GNorm = 0.3353, lr_0 = 9.9730e-04
Validation auc = 0.734760
Epoch 4185
Loss = 8.6618e-03, PNorm = 347.1398, GNorm = 0.8895, lr_0 = 9.9729e-04
Validation auc = 0.730184
Epoch 4186
Loss = 1.7081e-02, PNorm = 347.1746, GNorm = 0.1015, lr_0 = 9.9729e-04
Validation auc = 0.729569
Epoch 4187
Loss = 1.6839e-02, PNorm = 347.2087, GNorm = 0.5828, lr_0 = 9.9729e-04
Validation auc = 0.727092
Epoch 4188
Loss = 4.3136e-03, PNorm = 347.2390, GNorm = 0.2535, lr_0 = 9.9729e-04
Validation auc = 0.724864
Epoch 4189
Loss = 1.6893e-03, PNorm = 347.2674, GNorm = 0.0661, lr_0 = 9.9729e-04
Loss = 2.0337e-02, PNorm = 347.3024, GNorm = 0.5092, lr_0 = 9.9729e-04
Validation auc = 0.729413
Epoch 4190
Loss = 1.7317e-02, PNorm = 347.3389, GNorm = 2.5544, lr_0 = 9.9729e-04
Validation auc = 0.729381
Epoch 4191
Loss = 4.1896e-02, PNorm = 347.3804, GNorm = 0.0292, lr_0 = 9.9729e-04
Validation auc = 0.721968
Epoch 4192
Loss = 6.1231e-02, PNorm = 347.4374, GNorm = 0.1919, lr_0 = 9.9729e-04
Validation auc = 0.723283
Epoch 4193
Loss = 3.3322e-02, PNorm = 347.5018, GNorm = 2.5202, lr_0 = 9.9729e-04
Validation auc = 0.726656
Epoch 4194
Loss = 2.2673e-02, PNorm = 347.5602, GNorm = 1.8246, lr_0 = 9.9729e-04
Validation auc = 0.715273
Epoch 4195
Loss = 1.3065e-02, PNorm = 347.6216, GNorm = 1.0131, lr_0 = 9.9729e-04
Validation auc = 0.706188
Epoch 4196
Loss = 7.7677e-02, PNorm = 347.6679, GNorm = 1.2717, lr_0 = 9.9729e-04
Validation auc = 0.693812
Epoch 4197
Loss = 2.5513e-02, PNorm = 347.7194, GNorm = 2.4119, lr_0 = 9.9729e-04
Validation auc = 0.704794
Epoch 4198
Loss = 1.2540e-03, PNorm = 347.7886, GNorm = 0.2160, lr_0 = 9.9728e-04
Validation auc = 0.708439
Epoch 4199
Loss = 2.7850e-03, PNorm = 347.8391, GNorm = 0.1919, lr_0 = 9.9728e-04
Loss = 2.2121e-02, PNorm = 347.8803, GNorm = 0.0777, lr_0 = 9.9728e-04
Validation auc = 0.704224
Epoch 4200
Loss = 1.5371e-02, PNorm = 347.9338, GNorm = 0.0811, lr_0 = 9.9728e-04
Validation auc = 0.701356
Epoch 4201
Loss = 5.9945e-02, PNorm = 347.9703, GNorm = 0.0928, lr_0 = 9.9728e-04
Validation auc = 0.698993
Epoch 4202
Loss = 3.9934e-02, PNorm = 348.0147, GNorm = 0.0623, lr_0 = 9.9728e-04
Validation auc = 0.697388
Epoch 4203
Loss = 2.9923e-02, PNorm = 348.0601, GNorm = 0.0954, lr_0 = 9.9728e-04
Validation auc = 0.697592
Epoch 4204
Loss = 5.6473e-02, PNorm = 348.1087, GNorm = 0.5568, lr_0 = 9.9728e-04
Validation auc = 0.702342
Epoch 4205
Loss = 2.1478e-02, PNorm = 348.1487, GNorm = 0.2892, lr_0 = 9.9728e-04
Validation auc = 0.703968
Epoch 4206
Loss = 1.2466e-02, PNorm = 348.1863, GNorm = 0.3200, lr_0 = 9.9728e-04
Validation auc = 0.706453
Epoch 4207
Loss = 4.5717e-02, PNorm = 348.2211, GNorm = 0.8573, lr_0 = 9.9728e-04
Validation auc = 0.709838
Epoch 4208
Loss = 8.3599e-03, PNorm = 348.2649, GNorm = 0.1316, lr_0 = 9.9728e-04
Validation auc = 0.711932
Epoch 4209
Loss = 2.5979e-03, PNorm = 348.3051, GNorm = 0.0926, lr_0 = 9.9728e-04
Loss = 2.5538e-02, PNorm = 348.3302, GNorm = 0.0784, lr_0 = 9.9728e-04
Validation auc = 0.710566
Epoch 4210
Loss = 2.6313e-02, PNorm = 348.3517, GNorm = 0.6149, lr_0 = 9.9728e-04
Validation auc = 0.709823
Epoch 4211
Loss = 1.7725e-02, PNorm = 348.3820, GNorm = 0.0511, lr_0 = 9.9727e-04
Validation auc = 0.703291
Epoch 4212
Loss = 1.9963e-02, PNorm = 348.4120, GNorm = 0.3055, lr_0 = 9.9727e-04
Validation auc = 0.701645
Epoch 4213
Loss = 1.8673e-02, PNorm = 348.4376, GNorm = 0.5250, lr_0 = 9.9727e-04
Validation auc = 0.704528
Epoch 4214
Loss = 8.8146e-03, PNorm = 348.4602, GNorm = 0.0762, lr_0 = 9.9727e-04
Validation auc = 0.706494
Epoch 4215
Loss = 3.6246e-03, PNorm = 348.4784, GNorm = 0.5904, lr_0 = 9.9727e-04
Validation auc = 0.710258
Epoch 4216
Loss = 3.3303e-02, PNorm = 348.4938, GNorm = 0.0844, lr_0 = 9.9727e-04
Validation auc = 0.711519
Epoch 4217
Loss = 9.7461e-02, PNorm = 348.5167, GNorm = 3.4754, lr_0 = 9.9727e-04
Validation auc = 0.707326
Epoch 4218
Loss = 8.5656e-02, PNorm = 348.5831, GNorm = 5.6327, lr_0 = 9.9727e-04
Validation auc = 0.708613
Epoch 4219
Loss = 7.2682e-03, PNorm = 348.6786, GNorm = 0.4146, lr_0 = 9.9727e-04
Loss = 5.4867e-02, PNorm = 348.7522, GNorm = 1.1726, lr_0 = 9.9727e-04
Validation auc = 0.711447
Epoch 4220
Loss = 1.8044e-02, PNorm = 348.8161, GNorm = 0.2109, lr_0 = 9.9727e-04
Validation auc = 0.708699
Epoch 4221
Loss = 3.7643e-02, PNorm = 348.8587, GNorm = 0.1770, lr_0 = 9.9727e-04
Validation auc = 0.697843
Epoch 4222
Loss = 2.3442e-02, PNorm = 348.8938, GNorm = 1.7834, lr_0 = 9.9727e-04
Validation auc = 0.695498
Epoch 4223
Loss = 1.5765e-02, PNorm = 348.9261, GNorm = 3.0774, lr_0 = 9.9727e-04
Validation auc = 0.692679
Epoch 4224
Loss = 3.8252e-02, PNorm = 348.9654, GNorm = 1.4947, lr_0 = 9.9726e-04
Validation auc = 0.691611
Epoch 4225
Loss = 1.5340e-02, PNorm = 348.9970, GNorm = 2.4445, lr_0 = 9.9726e-04
Validation auc = 0.700659
Epoch 4226
Loss = 1.1932e-02, PNorm = 349.0336, GNorm = 0.0574, lr_0 = 9.9726e-04
Validation auc = 0.698244
Epoch 4227
Loss = 8.2118e-02, PNorm = 349.0688, GNorm = 1.1531, lr_0 = 9.9726e-04
Validation auc = 0.703334
Epoch 4228
Loss = 4.8139e-03, PNorm = 349.1151, GNorm = 0.4231, lr_0 = 9.9726e-04
Validation auc = 0.710459
Epoch 4229
Loss = 2.6206e-02, PNorm = 349.1583, GNorm = 1.3518, lr_0 = 9.9726e-04
Loss = 8.5761e-03, PNorm = 349.2054, GNorm = 0.1505, lr_0 = 9.9726e-04
Validation auc = 0.718460
Epoch 4230
Loss = 3.4797e-02, PNorm = 349.2409, GNorm = 0.5278, lr_0 = 9.9726e-04
Validation auc = 0.717447
Epoch 4231
Loss = 3.5284e-02, PNorm = 349.2884, GNorm = 3.1912, lr_0 = 9.9726e-04
Validation auc = 0.719558
Epoch 4232
Loss = 2.5713e-02, PNorm = 349.3549, GNorm = 0.5506, lr_0 = 9.9726e-04
Validation auc = 0.727518
Epoch 4233
Loss = 9.1678e-03, PNorm = 349.4049, GNorm = 0.7738, lr_0 = 9.9726e-04
Validation auc = 0.729413
Epoch 4234
Loss = 3.2115e-02, PNorm = 349.4522, GNorm = 0.8506, lr_0 = 9.9726e-04
Validation auc = 0.726147
Epoch 4235
Loss = 1.5571e-02, PNorm = 349.4982, GNorm = 0.0938, lr_0 = 9.9726e-04
Validation auc = 0.723143
Epoch 4236
Loss = 2.4356e-02, PNorm = 349.5437, GNorm = 1.2499, lr_0 = 9.9726e-04
Validation auc = 0.712035
Epoch 4237
Loss = 5.0495e-02, PNorm = 349.5800, GNorm = 2.3157, lr_0 = 9.9726e-04
Validation auc = 0.708340
Epoch 4238
Loss = 2.0335e-02, PNorm = 349.6199, GNorm = 1.9703, lr_0 = 9.9725e-04
Validation auc = 0.711057
Epoch 4239
Loss = 3.2269e-03, PNorm = 349.6623, GNorm = 0.1170, lr_0 = 9.9725e-04
Loss = 1.1299e-02, PNorm = 349.6941, GNorm = 0.6613, lr_0 = 9.9725e-04
Validation auc = 0.714858
Epoch 4240
Loss = 9.5509e-03, PNorm = 349.7182, GNorm = 2.5542, lr_0 = 9.9725e-04
Validation auc = 0.719114
Epoch 4241
Loss = 1.4108e-02, PNorm = 349.7404, GNorm = 1.3084, lr_0 = 9.9725e-04
Validation auc = 0.715541
Epoch 4242
Loss = 1.2337e-02, PNorm = 349.7742, GNorm = 0.1120, lr_0 = 9.9725e-04
Validation auc = 0.712029
Epoch 4243
Loss = 2.9792e-02, PNorm = 349.8036, GNorm = 2.6318, lr_0 = 9.9725e-04
Validation auc = 0.714987
Epoch 4244
Loss = 2.9663e-02, PNorm = 349.8464, GNorm = 1.6841, lr_0 = 9.9725e-04
Validation auc = 0.715823
Epoch 4245
Loss = 2.8112e-02, PNorm = 349.8852, GNorm = 0.0759, lr_0 = 9.9725e-04
Validation auc = 0.717634
Epoch 4246
Loss = 2.9933e-02, PNorm = 349.9251, GNorm = 0.1408, lr_0 = 9.9725e-04
Validation auc = 0.707861
Epoch 4247
Loss = 1.7557e-02, PNorm = 349.9663, GNorm = 1.0539, lr_0 = 9.9725e-04
Validation auc = 0.706607
Epoch 4248
Loss = 2.9832e-02, PNorm = 350.0116, GNorm = 0.2746, lr_0 = 9.9725e-04
Validation auc = 0.701102
Epoch 4249
Loss = 1.4451e-03, PNorm = 350.0526, GNorm = 0.0580, lr_0 = 9.9725e-04
Loss = 3.3141e-02, PNorm = 350.0963, GNorm = 0.1643, lr_0 = 9.9725e-04
Validation auc = 0.711158
Epoch 4250
Loss = 1.9262e-02, PNorm = 350.1331, GNorm = 0.1316, lr_0 = 9.9724e-04
Validation auc = 0.711275
Epoch 4251
Loss = 1.8381e-02, PNorm = 350.1777, GNorm = 0.6395, lr_0 = 9.9724e-04
Validation auc = 0.711060
Epoch 4252
Loss = 2.3777e-02, PNorm = 350.2194, GNorm = 1.7217, lr_0 = 9.9724e-04
Validation auc = 0.714856
Epoch 4253
Loss = 8.9312e-02, PNorm = 350.2723, GNorm = 3.3978, lr_0 = 9.9724e-04
Validation auc = 0.691881
Epoch 4254
Loss = 2.8666e-02, PNorm = 350.3329, GNorm = 0.9690, lr_0 = 9.9724e-04
Validation auc = 0.685420
Epoch 4255
Loss = 1.4944e-02, PNorm = 350.3993, GNorm = 0.2091, lr_0 = 9.9724e-04
Validation auc = 0.680664
Epoch 4256
Loss = 3.2569e-02, PNorm = 350.4567, GNorm = 0.0575, lr_0 = 9.9724e-04
Validation auc = 0.674392
Epoch 4257
Loss = 2.4441e-02, PNorm = 350.5034, GNorm = 1.3173, lr_0 = 9.9724e-04
Validation auc = 0.667556
Epoch 4258
Loss = 1.0332e-02, PNorm = 350.5481, GNorm = 0.6989, lr_0 = 9.9724e-04
Validation auc = 0.672408
Epoch 4259
Loss = 1.2655e-01, PNorm = 350.5917, GNorm = 1.4242, lr_0 = 9.9724e-04
Loss = 3.7381e-02, PNorm = 350.6390, GNorm = 1.5686, lr_0 = 9.9724e-04
Validation auc = 0.683996
Epoch 4260
Loss = 3.7881e-02, PNorm = 350.6926, GNorm = 2.7250, lr_0 = 9.9724e-04
Validation auc = 0.694552
Epoch 4261
Loss = 3.2895e-02, PNorm = 350.7491, GNorm = 2.0664, lr_0 = 9.9724e-04
Validation auc = 0.702851
Epoch 4262
Loss = 3.3240e-02, PNorm = 350.8007, GNorm = 1.1737, lr_0 = 9.9724e-04
Validation auc = 0.710755
Epoch 4263
Loss = 3.6610e-02, PNorm = 350.8553, GNorm = 1.0841, lr_0 = 9.9724e-04
Validation auc = 0.721913
Epoch 4264
Loss = 2.9759e-02, PNorm = 350.9090, GNorm = 0.2557, lr_0 = 9.9723e-04
Validation auc = 0.730880
Epoch 4265
Loss = 6.2769e-03, PNorm = 350.9445, GNorm = 0.7309, lr_0 = 9.9723e-04
Validation auc = 0.731743
Epoch 4266
Loss = 3.9614e-02, PNorm = 350.9691, GNorm = 1.2984, lr_0 = 9.9723e-04
Validation auc = 0.725987
Epoch 4267
Loss = 3.2293e-03, PNorm = 350.9941, GNorm = 0.0529, lr_0 = 9.9723e-04
Validation auc = 0.725825
Epoch 4268
Loss = 2.2030e-02, PNorm = 351.0214, GNorm = 1.2309, lr_0 = 9.9723e-04
Validation auc = 0.722403
Epoch 4269
Loss = 2.5465e-02, PNorm = 351.0590, GNorm = 0.4780, lr_0 = 9.9723e-04
Loss = 1.4097e-02, PNorm = 351.1050, GNorm = 0.6691, lr_0 = 9.9723e-04
Validation auc = 0.721630
Epoch 4270
Loss = 1.4192e-02, PNorm = 351.1430, GNorm = 0.4515, lr_0 = 9.9723e-04
Validation auc = 0.719315
Epoch 4271
Loss = 1.3684e-02, PNorm = 351.1775, GNorm = 3.0902, lr_0 = 9.9723e-04
Validation auc = 0.718549
Epoch 4272
Loss = 7.5738e-02, PNorm = 351.2187, GNorm = 1.1260, lr_0 = 9.9723e-04
Validation auc = 0.696366
Epoch 4273
Loss = 2.9641e-02, PNorm = 351.2736, GNorm = 0.2550, lr_0 = 9.9723e-04
Validation auc = 0.695268
Epoch 4274
Loss = 1.6204e-02, PNorm = 351.3183, GNorm = 0.9085, lr_0 = 9.9723e-04
Validation auc = 0.698751
Epoch 4275
Loss = 3.5523e-02, PNorm = 351.3566, GNorm = 0.9497, lr_0 = 9.9723e-04
Validation auc = 0.695575
Epoch 4276
Loss = 2.9233e-02, PNorm = 351.3986, GNorm = 0.2562, lr_0 = 9.9723e-04
Validation auc = 0.697599
Epoch 4277
Loss = 1.3224e-02, PNorm = 351.4367, GNorm = 0.2605, lr_0 = 9.9722e-04
Validation auc = 0.716427
Epoch 4278
Loss = 3.8218e-03, PNorm = 351.4734, GNorm = 0.3506, lr_0 = 9.9722e-04
Validation auc = 0.721231
Epoch 4279
Loss = 3.6780e-03, PNorm = 351.5069, GNorm = 0.3139, lr_0 = 9.9722e-04
Loss = 3.5926e-02, PNorm = 351.5413, GNorm = 0.5015, lr_0 = 9.9722e-04
Validation auc = 0.717739
Epoch 4280
Loss = 1.5640e-02, PNorm = 351.5749, GNorm = 0.6271, lr_0 = 9.9722e-04
Validation auc = 0.716602
Epoch 4281
Loss = 1.8950e-02, PNorm = 351.6037, GNorm = 1.7767, lr_0 = 9.9722e-04
Validation auc = 0.717738
Epoch 4282
Loss = 3.1822e-02, PNorm = 351.6405, GNorm = 0.0102, lr_0 = 9.9722e-04
Validation auc = 0.716975
Epoch 4283
Loss = 6.3302e-02, PNorm = 351.6818, GNorm = 2.0481, lr_0 = 9.9722e-04
Validation auc = 0.726642
Epoch 4284
Loss = 3.5569e-02, PNorm = 351.7430, GNorm = 0.9957, lr_0 = 9.9722e-04
Validation auc = 0.729559
Epoch 4285
Loss = 4.5420e-03, PNorm = 351.8059, GNorm = 0.2942, lr_0 = 9.9722e-04
Validation auc = 0.720799
Epoch 4286
Loss = 7.4596e-03, PNorm = 351.8650, GNorm = 0.1039, lr_0 = 9.9722e-04
Validation auc = 0.718441
Epoch 4287
Loss = 2.6615e-02, PNorm = 351.9201, GNorm = 0.4489, lr_0 = 9.9722e-04
Validation auc = 0.713660
Epoch 4288
Loss = 7.7932e-03, PNorm = 351.9617, GNorm = 0.4647, lr_0 = 9.9722e-04
Validation auc = 0.710178
Epoch 4289
Loss = 6.5936e-03, PNorm = 351.9928, GNorm = 0.4626, lr_0 = 9.9722e-04
Loss = 1.6938e-02, PNorm = 352.0178, GNorm = 0.0968, lr_0 = 9.9722e-04
Validation auc = 0.708052
Epoch 4290
Loss = 5.0823e-02, PNorm = 352.0606, GNorm = 0.1346, lr_0 = 9.9721e-04
Validation auc = 0.708308
Epoch 4291
Loss = 1.5010e-02, PNorm = 352.1088, GNorm = 0.1618, lr_0 = 9.9721e-04
Validation auc = 0.707747
Epoch 4292
Loss = 9.6962e-02, PNorm = 352.1495, GNorm = 0.2897, lr_0 = 9.9721e-04
Validation auc = 0.713873
Epoch 4293
Loss = 2.7371e-02, PNorm = 352.1938, GNorm = 0.6123, lr_0 = 9.9721e-04
Validation auc = 0.713302
Epoch 4294
Loss = 2.2786e-02, PNorm = 352.2306, GNorm = 0.3076, lr_0 = 9.9721e-04
Validation auc = 0.713400
Epoch 4295
Loss = 1.1075e-02, PNorm = 352.2704, GNorm = 0.4633, lr_0 = 9.9721e-04
Validation auc = 0.709387
Epoch 4296
Loss = 4.5402e-02, PNorm = 352.3103, GNorm = 0.7721, lr_0 = 9.9721e-04
Validation auc = 0.709718
Epoch 4297
Loss = 5.2688e-02, PNorm = 352.3481, GNorm = 0.6910, lr_0 = 9.9721e-04
Validation auc = 0.710983
Epoch 4298
Loss = 7.9065e-02, PNorm = 352.3962, GNorm = 2.4485, lr_0 = 9.9721e-04
Validation auc = 0.717241
Epoch 4299
Loss = 8.7089e-03, PNorm = 352.4501, GNorm = 0.3109, lr_0 = 9.9721e-04
Loss = 4.0075e-02, PNorm = 352.4910, GNorm = 0.6219, lr_0 = 9.9721e-04
Validation auc = 0.714974
Epoch 4300
Loss = 1.1920e-02, PNorm = 352.5344, GNorm = 0.4544, lr_0 = 9.9721e-04
Validation auc = 0.709007
Epoch 4301
Loss = 3.5248e-02, PNorm = 352.5706, GNorm = 1.0728, lr_0 = 9.9721e-04
Validation auc = 0.712287
Epoch 4302
Loss = 9.8222e-03, PNorm = 352.6102, GNorm = 0.1431, lr_0 = 9.9721e-04
Validation auc = 0.717366
Epoch 4303
Loss = 1.9131e-02, PNorm = 352.6462, GNorm = 0.0414, lr_0 = 9.9721e-04
Validation auc = 0.728731
Epoch 4304
Loss = 4.3958e-02, PNorm = 352.6816, GNorm = 2.0039, lr_0 = 9.9720e-04
Validation auc = 0.725423
Epoch 4305
Loss = 2.9913e-02, PNorm = 352.7183, GNorm = 0.4636, lr_0 = 9.9720e-04
Validation auc = 0.729810
Epoch 4306
Loss = 1.8224e-02, PNorm = 352.7520, GNorm = 1.3894, lr_0 = 9.9720e-04
Validation auc = 0.727462
Epoch 4307
Loss = 1.1040e-01, PNorm = 352.7943, GNorm = 2.1223, lr_0 = 9.9720e-04
Validation auc = 0.720232
Epoch 4308
Loss = 1.0080e-01, PNorm = 352.8559, GNorm = 0.0946, lr_0 = 9.9720e-04
Validation auc = 0.721374
Epoch 4309
Loss = 9.8464e-02, PNorm = 352.9200, GNorm = 1.1984, lr_0 = 9.9720e-04
Loss = 3.9708e-02, PNorm = 352.9697, GNorm = 0.7225, lr_0 = 9.9720e-04
Validation auc = 0.726663
Epoch 4310
Loss = 2.0197e-02, PNorm = 353.0076, GNorm = 0.1032, lr_0 = 9.9720e-04
Validation auc = 0.726972
Epoch 4311
Loss = 1.9849e-02, PNorm = 353.0440, GNorm = 0.0300, lr_0 = 9.9720e-04
Validation auc = 0.731260
Epoch 4312
Loss = 1.5566e-02, PNorm = 353.0718, GNorm = 1.8968, lr_0 = 9.9720e-04
Validation auc = 0.726375
Epoch 4313
Loss = 2.0368e-02, PNorm = 353.0980, GNorm = 1.0608, lr_0 = 9.9720e-04
Validation auc = 0.724248
Epoch 4314
Loss = 1.9029e-02, PNorm = 353.1307, GNorm = 0.1091, lr_0 = 9.9720e-04
Validation auc = 0.724370
Epoch 4315
Loss = 1.0651e-02, PNorm = 353.1642, GNorm = 0.0712, lr_0 = 9.9720e-04
Validation auc = 0.719845
Epoch 4316
Loss = 1.2474e-01, PNorm = 353.2105, GNorm = 0.0791, lr_0 = 9.9720e-04
Validation auc = 0.712614
Epoch 4317
Loss = 1.2181e-02, PNorm = 353.2637, GNorm = 0.8305, lr_0 = 9.9719e-04
Validation auc = 0.705074
Epoch 4318
Loss = 1.6310e-02, PNorm = 353.3066, GNorm = 0.2828, lr_0 = 9.9719e-04
Validation auc = 0.693958
Epoch 4319
Loss = 7.5361e-02, PNorm = 353.3508, GNorm = 2.1918, lr_0 = 9.9719e-04
Loss = 3.1351e-02, PNorm = 353.3983, GNorm = 0.0954, lr_0 = 9.9719e-04
Validation auc = 0.692004
Epoch 4320
Loss = 2.3835e-02, PNorm = 353.4406, GNorm = 1.5469, lr_0 = 9.9719e-04
Validation auc = 0.689792
Epoch 4321
Loss = 2.7022e-02, PNorm = 353.4840, GNorm = 0.5818, lr_0 = 9.9719e-04
Validation auc = 0.683325
Epoch 4322
Loss = 1.3118e-02, PNorm = 353.5335, GNorm = 0.1080, lr_0 = 9.9719e-04
Validation auc = 0.674091
Epoch 4323
Loss = 7.4173e-03, PNorm = 353.5744, GNorm = 0.1647, lr_0 = 9.9719e-04
Validation auc = 0.672503
Epoch 4324
Loss = 2.9807e-02, PNorm = 353.6065, GNorm = 0.3864, lr_0 = 9.9719e-04
Validation auc = 0.677230
Epoch 4325
Loss = 2.9320e-02, PNorm = 353.6361, GNorm = 0.0291, lr_0 = 9.9719e-04
Validation auc = 0.682253
Epoch 4326
Loss = 1.8410e-02, PNorm = 353.6671, GNorm = 0.1013, lr_0 = 9.9719e-04
Validation auc = 0.692696
Epoch 4327
Loss = 8.1956e-03, PNorm = 353.6930, GNorm = 1.6878, lr_0 = 9.9719e-04
Validation auc = 0.697533
Epoch 4328
Loss = 2.7148e-02, PNorm = 353.7144, GNorm = 2.0680, lr_0 = 9.9719e-04
Validation auc = 0.691418
Epoch 4329
Loss = 7.3889e-02, PNorm = 353.7351, GNorm = 1.7603, lr_0 = 9.9719e-04
Loss = 9.8477e-03, PNorm = 353.7560, GNorm = 0.0468, lr_0 = 9.9719e-04
Validation auc = 0.687538
Epoch 4330
Loss = 1.5725e-02, PNorm = 353.7772, GNorm = 0.1156, lr_0 = 9.9718e-04
Validation auc = 0.687279
Epoch 4331
Loss = 3.2467e-02, PNorm = 353.8045, GNorm = 0.1323, lr_0 = 9.9718e-04
Validation auc = 0.689572
Epoch 4332
Loss = 4.9258e-02, PNorm = 353.8457, GNorm = 0.3029, lr_0 = 9.9718e-04
Validation auc = 0.698546
Epoch 4333
Loss = 3.4212e-02, PNorm = 353.8883, GNorm = 0.1496, lr_0 = 9.9718e-04
Validation auc = 0.699053
Epoch 4334
Loss = 4.0838e-02, PNorm = 353.9204, GNorm = 0.2849, lr_0 = 9.9718e-04
Validation auc = 0.703066
Epoch 4335
Loss = 5.7633e-03, PNorm = 353.9498, GNorm = 0.0511, lr_0 = 9.9718e-04
Validation auc = 0.705092
Epoch 4336
Loss = 9.0692e-03, PNorm = 353.9741, GNorm = 0.0589, lr_0 = 9.9718e-04
Validation auc = 0.704397
Epoch 4337
Loss = 2.4337e-02, PNorm = 353.9994, GNorm = 1.1804, lr_0 = 9.9718e-04
Validation auc = 0.704288
Epoch 4338
Loss = 8.1060e-02, PNorm = 354.0226, GNorm = 2.8169, lr_0 = 9.9718e-04
Validation auc = 0.703423
Epoch 4339
Loss = 8.9973e-02, PNorm = 354.0523, GNorm = 1.5862, lr_0 = 9.9718e-04
Loss = 4.4393e-02, PNorm = 354.0863, GNorm = 1.6258, lr_0 = 9.9718e-04
Validation auc = 0.714420
Epoch 4340
Loss = 3.5842e-02, PNorm = 354.1375, GNorm = 2.6210, lr_0 = 9.9718e-04
Validation auc = 0.710003
Epoch 4341
Loss = 2.6509e-02, PNorm = 354.1923, GNorm = 0.6863, lr_0 = 9.9718e-04
Validation auc = 0.692400
Epoch 4342
Loss = 6.2997e-03, PNorm = 354.2301, GNorm = 0.0253, lr_0 = 9.9718e-04
Validation auc = 0.683419
Epoch 4343
Loss = 2.3056e-02, PNorm = 354.2566, GNorm = 0.0934, lr_0 = 9.9717e-04
Validation auc = 0.679751
Epoch 4344
Loss = 2.4059e-02, PNorm = 354.2770, GNorm = 0.7309, lr_0 = 9.9717e-04
Validation auc = 0.679630
Epoch 4345
Loss = 2.6385e-02, PNorm = 354.2991, GNorm = 0.2619, lr_0 = 9.9717e-04
Validation auc = 0.675916
Epoch 4346
Loss = 1.9402e-02, PNorm = 354.3213, GNorm = 1.5735, lr_0 = 9.9717e-04
Validation auc = 0.664891
Epoch 4347
Loss = 1.3303e-02, PNorm = 354.3546, GNorm = 0.0236, lr_0 = 9.9717e-04
Validation auc = 0.668702
Epoch 4348
Loss = 3.5435e-02, PNorm = 354.3862, GNorm = 2.1487, lr_0 = 9.9717e-04
Validation auc = 0.673162
Epoch 4349
Loss = 4.5811e-03, PNorm = 354.4129, GNorm = 0.2839, lr_0 = 9.9717e-04
Loss = 5.2668e-03, PNorm = 354.4401, GNorm = 0.0155, lr_0 = 9.9717e-04
Validation auc = 0.681113
Epoch 4350
Loss = 3.2589e-02, PNorm = 354.4658, GNorm = 0.2820, lr_0 = 9.9717e-04
Validation auc = 0.687676
Epoch 4351
Loss = 5.1818e-02, PNorm = 354.4965, GNorm = 0.5382, lr_0 = 9.9717e-04
Validation auc = 0.704321
Epoch 4352
Loss = 2.1524e-02, PNorm = 354.5324, GNorm = 0.5216, lr_0 = 9.9717e-04
Validation auc = 0.713952
Epoch 4353
Loss = 2.7229e-02, PNorm = 354.5652, GNorm = 0.1564, lr_0 = 9.9717e-04
Validation auc = 0.715260
Epoch 4354
Loss = 1.8082e-02, PNorm = 354.5997, GNorm = 0.1191, lr_0 = 9.9717e-04
Validation auc = 0.716216
Epoch 4355
Loss = 6.8107e-03, PNorm = 354.6310, GNorm = 0.0200, lr_0 = 9.9717e-04
Validation auc = 0.714718
Epoch 4356
Loss = 1.4463e-03, PNorm = 354.6568, GNorm = 0.0122, lr_0 = 9.9717e-04
Validation auc = 0.711408
Epoch 4357
Loss = 1.4425e-02, PNorm = 354.6730, GNorm = 0.8575, lr_0 = 9.9716e-04
Validation auc = 0.708220
Epoch 4358
Loss = 1.0873e-01, PNorm = 354.7001, GNorm = 4.2839, lr_0 = 9.9716e-04
Validation auc = 0.712120
Epoch 4359
Loss = 9.8627e-03, PNorm = 354.7470, GNorm = 0.6999, lr_0 = 9.9716e-04
Loss = 2.1056e-02, PNorm = 354.7838, GNorm = 0.3277, lr_0 = 9.9716e-04
Validation auc = 0.714067
Epoch 4360
Loss = 4.7259e-02, PNorm = 354.8268, GNorm = 2.7345, lr_0 = 9.9716e-04
Validation auc = 0.720997
Epoch 4361
Loss = 1.4754e-02, PNorm = 354.8748, GNorm = 1.0358, lr_0 = 9.9716e-04
Validation auc = 0.725789
Epoch 4362
Loss = 3.9482e-02, PNorm = 354.9133, GNorm = 0.4429, lr_0 = 9.9716e-04
Validation auc = 0.719124
Epoch 4363
Loss = 3.8567e-02, PNorm = 354.9498, GNorm = 1.0425, lr_0 = 9.9716e-04
Validation auc = 0.722313
Epoch 4364
Loss = 1.4453e-02, PNorm = 355.0017, GNorm = 0.3634, lr_0 = 9.9716e-04
Validation auc = 0.723884
Epoch 4365
Loss = 3.9533e-02, PNorm = 355.0387, GNorm = 0.1067, lr_0 = 9.9716e-04
Validation auc = 0.729392
Epoch 4366
Loss = 1.5796e-02, PNorm = 355.0691, GNorm = 1.0930, lr_0 = 9.9716e-04
Validation auc = 0.731229
Epoch 4367
Loss = 2.6932e-02, PNorm = 355.1169, GNorm = 0.1205, lr_0 = 9.9716e-04
Validation auc = 0.731137
Epoch 4368
Loss = 1.7480e-03, PNorm = 355.1767, GNorm = 0.1698, lr_0 = 9.9716e-04
Validation auc = 0.721347
Epoch 4369
Loss = 2.6021e-03, PNorm = 355.2341, GNorm = 0.1524, lr_0 = 9.9716e-04
Loss = 9.7793e-03, PNorm = 355.2748, GNorm = 1.3401, lr_0 = 9.9715e-04
Validation auc = 0.715540
Epoch 4370
Loss = 9.5511e-02, PNorm = 355.3140, GNorm = 1.1955, lr_0 = 9.9715e-04
Validation auc = 0.710363
Epoch 4371
Loss = 3.8090e-02, PNorm = 355.3657, GNorm = 1.6095, lr_0 = 9.9715e-04
Validation auc = 0.704736
Epoch 4372
Loss = 1.0745e-02, PNorm = 355.4094, GNorm = 0.2238, lr_0 = 9.9715e-04
Validation auc = 0.709733
Epoch 4373
Loss = 3.7176e-02, PNorm = 355.4495, GNorm = 0.1519, lr_0 = 9.9715e-04
Validation auc = 0.724847
Epoch 4374
Loss = 2.1486e-02, PNorm = 355.4870, GNorm = 0.3398, lr_0 = 9.9715e-04
Validation auc = 0.729707
Epoch 4375
Loss = 2.6124e-02, PNorm = 355.5270, GNorm = 2.6410, lr_0 = 9.9715e-04
Validation auc = 0.732282
Epoch 4376
Loss = 3.3684e-02, PNorm = 355.5648, GNorm = 2.2335, lr_0 = 9.9715e-04
Validation auc = 0.728591
Epoch 4377
Loss = 4.2010e-02, PNorm = 355.6090, GNorm = 1.7325, lr_0 = 9.9715e-04
Validation auc = 0.722129
Epoch 4378
Loss = 7.7379e-02, PNorm = 355.6521, GNorm = 4.0418, lr_0 = 9.9715e-04
Validation auc = 0.734381
Epoch 4379
Loss = 1.5456e-02, PNorm = 355.7064, GNorm = 0.6516, lr_0 = 9.9715e-04
Loss = 2.1407e-02, PNorm = 355.7580, GNorm = 3.4437, lr_0 = 9.9715e-04
Validation auc = 0.736823
Epoch 4380
Loss = 2.3268e-02, PNorm = 355.8027, GNorm = 0.1354, lr_0 = 9.9715e-04
Validation auc = 0.738002
Epoch 4381
Loss = 4.2719e-02, PNorm = 355.8428, GNorm = 2.1038, lr_0 = 9.9715e-04
Validation auc = 0.731064
Epoch 4382
Loss = 8.8667e-03, PNorm = 355.8848, GNorm = 0.1154, lr_0 = 9.9715e-04
Validation auc = 0.729800
Epoch 4383
Loss = 4.1168e-02, PNorm = 355.9180, GNorm = 0.7834, lr_0 = 9.9714e-04
Validation auc = 0.728123
Epoch 4384
Loss = 1.4341e-02, PNorm = 355.9495, GNorm = 1.2671, lr_0 = 9.9714e-04
Validation auc = 0.722929
Epoch 4385
Loss = 3.4602e-02, PNorm = 355.9802, GNorm = 0.3323, lr_0 = 9.9714e-04
Validation auc = 0.726339
Epoch 4386
Loss = 1.5327e-02, PNorm = 356.0156, GNorm = 0.0580, lr_0 = 9.9714e-04
Validation auc = 0.721118
Epoch 4387
Loss = 2.0850e-02, PNorm = 356.0510, GNorm = 1.7159, lr_0 = 9.9714e-04
Validation auc = 0.712900
Epoch 4388
Loss = 1.8484e-02, PNorm = 356.0987, GNorm = 0.5923, lr_0 = 9.9714e-04
Validation auc = 0.708485
Epoch 4389
Loss = 1.8061e-03, PNorm = 356.1524, GNorm = 0.0740, lr_0 = 9.9714e-04
Loss = 2.2241e-02, PNorm = 356.1995, GNorm = 0.9548, lr_0 = 9.9714e-04
Validation auc = 0.706986
Epoch 4390
Loss = 3.1383e-02, PNorm = 356.2354, GNorm = 1.8581, lr_0 = 9.9714e-04
Validation auc = 0.709599
Epoch 4391
Loss = 1.3879e-02, PNorm = 356.2644, GNorm = 1.1782, lr_0 = 9.9714e-04
Validation auc = 0.714751
Epoch 4392
Loss = 2.3922e-02, PNorm = 356.3060, GNorm = 0.4543, lr_0 = 9.9714e-04
Validation auc = 0.714229
Epoch 4393
Loss = 8.9157e-03, PNorm = 356.3558, GNorm = 0.3223, lr_0 = 9.9714e-04
Validation auc = 0.717606
Epoch 4394
Loss = 7.4591e-03, PNorm = 356.3915, GNorm = 0.6910, lr_0 = 9.9714e-04
Validation auc = 0.712406
Epoch 4395
Loss = 5.3977e-02, PNorm = 356.4215, GNorm = 1.4767, lr_0 = 9.9714e-04
Validation auc = 0.712106
Epoch 4396
Loss = 1.2005e-02, PNorm = 356.4597, GNorm = 0.2302, lr_0 = 9.9714e-04
Validation auc = 0.707103
Epoch 4397
Loss = 1.8290e-02, PNorm = 356.5060, GNorm = 0.1683, lr_0 = 9.9713e-04
Validation auc = 0.710788
Epoch 4398
Loss = 1.6652e-02, PNorm = 356.5490, GNorm = 1.9534, lr_0 = 9.9713e-04
Validation auc = 0.711277
Epoch 4399
Loss = 2.7625e-01, PNorm = 356.5832, GNorm = 2.2949, lr_0 = 9.9713e-04
Loss = 1.5675e-02, PNorm = 356.6181, GNorm = 0.0384, lr_0 = 9.9713e-04
Validation auc = 0.712525
Epoch 4400
Loss = 3.1883e-02, PNorm = 356.6492, GNorm = 0.8375, lr_0 = 9.9713e-04
Validation auc = 0.716365
Epoch 4401
Loss = 2.0805e-02, PNorm = 356.6843, GNorm = 0.1055, lr_0 = 9.9713e-04
Validation auc = 0.718112
Epoch 4402
Loss = 3.2168e-02, PNorm = 356.7178, GNorm = 0.6577, lr_0 = 9.9713e-04
Validation auc = 0.717586
Epoch 4403
Loss = 1.3192e-02, PNorm = 356.7536, GNorm = 1.4837, lr_0 = 9.9713e-04
Validation auc = 0.721469
Epoch 4404
Loss = 8.3105e-02, PNorm = 356.7830, GNorm = 2.6711, lr_0 = 9.9713e-04
Validation auc = 0.716494
Epoch 4405
Loss = 1.3352e-02, PNorm = 356.8191, GNorm = 0.1553, lr_0 = 9.9713e-04
Validation auc = 0.716523
Epoch 4406
Loss = 1.3916e-02, PNorm = 356.8525, GNorm = 0.3111, lr_0 = 9.9713e-04
Validation auc = 0.721891
Epoch 4407
Loss = 4.4548e-02, PNorm = 356.8849, GNorm = 0.0640, lr_0 = 9.9713e-04
Validation auc = 0.723379
Epoch 4408
Loss = 2.8604e-02, PNorm = 356.9173, GNorm = 4.2590, lr_0 = 9.9713e-04
Validation auc = 0.716571
Epoch 4409
Loss = 1.3366e-02, PNorm = 356.9648, GNorm = 0.6518, lr_0 = 9.9713e-04
Loss = 9.5112e-02, PNorm = 357.0271, GNorm = 0.6687, lr_0 = 9.9712e-04
Validation auc = 0.700533
Epoch 4410
Loss = 2.4542e-02, PNorm = 357.0953, GNorm = 0.1971, lr_0 = 9.9712e-04
Validation auc = 0.697642
Epoch 4411
Loss = 3.1518e-02, PNorm = 357.1466, GNorm = 0.1937, lr_0 = 9.9712e-04
Validation auc = 0.700962
Epoch 4412
Loss = 2.6943e-02, PNorm = 357.1983, GNorm = 0.1267, lr_0 = 9.9712e-04
Validation auc = 0.699558
Epoch 4413
Loss = 2.6304e-02, PNorm = 357.2433, GNorm = 0.9494, lr_0 = 9.9712e-04
Validation auc = 0.708319
Epoch 4414
Loss = 8.4062e-02, PNorm = 357.2892, GNorm = 0.0637, lr_0 = 9.9712e-04
Validation auc = 0.712732
Epoch 4415
Loss = 3.8488e-02, PNorm = 357.3478, GNorm = 0.8676, lr_0 = 9.9712e-04
Validation auc = 0.707666
Epoch 4416
Loss = 3.1158e-02, PNorm = 357.3971, GNorm = 0.6342, lr_0 = 9.9712e-04
Validation auc = 0.705888
Epoch 4417
Loss = 2.6098e-02, PNorm = 357.4303, GNorm = 0.0740, lr_0 = 9.9712e-04
Validation auc = 0.712324
Epoch 4418
Loss = 6.1710e-03, PNorm = 357.4583, GNorm = 0.2485, lr_0 = 9.9712e-04
Validation auc = 0.714477
Epoch 4419
Loss = 3.1257e-03, PNorm = 357.4854, GNorm = 0.1469, lr_0 = 9.9712e-04
Loss = 1.6897e-02, PNorm = 357.5172, GNorm = 0.0512, lr_0 = 9.9712e-04
Validation auc = 0.714507
Epoch 4420
Loss = 2.3620e-02, PNorm = 357.5513, GNorm = 1.5102, lr_0 = 9.9712e-04
Validation auc = 0.717801
Epoch 4421
Loss = 2.5474e-02, PNorm = 357.5871, GNorm = 1.5011, lr_0 = 9.9712e-04
Validation auc = 0.721660
Epoch 4422
Loss = 1.8446e-02, PNorm = 357.6187, GNorm = 0.8769, lr_0 = 9.9712e-04
Validation auc = 0.722700
Epoch 4423
Loss = 2.0354e-02, PNorm = 357.6463, GNorm = 0.6097, lr_0 = 9.9711e-04
Validation auc = 0.725667
Epoch 4424
Loss = 2.8887e-02, PNorm = 357.6745, GNorm = 0.5896, lr_0 = 9.9711e-04
Validation auc = 0.722209
Epoch 4425
Loss = 2.2205e-02, PNorm = 357.7062, GNorm = 1.0664, lr_0 = 9.9711e-04
Validation auc = 0.720383
Epoch 4426
Loss = 8.9728e-02, PNorm = 357.7396, GNorm = 2.5653, lr_0 = 9.9711e-04
Validation auc = 0.711242
Epoch 4427
Loss = 6.2120e-02, PNorm = 357.7790, GNorm = 2.2628, lr_0 = 9.9711e-04
Validation auc = 0.711627
Epoch 4428
Loss = 5.0966e-03, PNorm = 357.8150, GNorm = 0.1118, lr_0 = 9.9711e-04
Validation auc = 0.709578
Epoch 4429
Loss = 2.0581e-02, PNorm = 357.8460, GNorm = 0.4995, lr_0 = 9.9711e-04
Loss = 1.4299e-02, PNorm = 357.8743, GNorm = 0.0624, lr_0 = 9.9711e-04
Validation auc = 0.710595
Epoch 4430
Loss = 1.3652e-02, PNorm = 357.9019, GNorm = 0.1203, lr_0 = 9.9711e-04
Validation auc = 0.708479
Epoch 4431
Loss = 4.3262e-02, PNorm = 357.9275, GNorm = 0.1807, lr_0 = 9.9711e-04
Validation auc = 0.710936
Epoch 4432
Loss = 1.2098e-02, PNorm = 357.9545, GNorm = 0.3105, lr_0 = 9.9711e-04
Validation auc = 0.703664
Epoch 4433
Loss = 3.9258e-02, PNorm = 357.9794, GNorm = 2.7164, lr_0 = 9.9711e-04
Validation auc = 0.700358
Epoch 4434
Loss = 8.2519e-03, PNorm = 358.0111, GNorm = 1.0770, lr_0 = 9.9711e-04
Validation auc = 0.707385
Epoch 4435
Loss = 2.4331e-02, PNorm = 358.0347, GNorm = 0.4428, lr_0 = 9.9711e-04
Validation auc = 0.714139
Epoch 4436
Loss = 8.1039e-03, PNorm = 358.0623, GNorm = 2.3625, lr_0 = 9.9710e-04
Validation auc = 0.720415
Epoch 4437
Loss = 6.0789e-03, PNorm = 358.0932, GNorm = 1.4450, lr_0 = 9.9710e-04
Validation auc = 0.722585
Epoch 4438
Loss = 4.3156e-02, PNorm = 358.1213, GNorm = 1.1660, lr_0 = 9.9710e-04
Validation auc = 0.716865
Epoch 4439
Loss = 1.7372e-02, PNorm = 358.1541, GNorm = 0.6164, lr_0 = 9.9710e-04
Loss = 3.8874e-02, PNorm = 358.1867, GNorm = 0.9520, lr_0 = 9.9710e-04
Validation auc = 0.717476
Epoch 4440
Loss = 2.1307e-02, PNorm = 358.2176, GNorm = 1.4935, lr_0 = 9.9710e-04
Validation auc = 0.720560
Epoch 4441
Loss = 2.4158e-02, PNorm = 358.2470, GNorm = 0.8121, lr_0 = 9.9710e-04
Validation auc = 0.717051
Epoch 4442
Loss = 1.6489e-02, PNorm = 358.2758, GNorm = 0.1938, lr_0 = 9.9710e-04
Validation auc = 0.714673
Epoch 4443
Loss = 4.2607e-02, PNorm = 358.2951, GNorm = 0.4530, lr_0 = 9.9710e-04
Validation auc = 0.712561
Epoch 4444
Loss = 1.4501e-02, PNorm = 358.3223, GNorm = 0.9372, lr_0 = 9.9710e-04
Validation auc = 0.712130
Epoch 4445
Loss = 2.2387e-02, PNorm = 358.3546, GNorm = 1.9121, lr_0 = 9.9710e-04
Validation auc = 0.706338
Epoch 4446
Loss = 7.2828e-02, PNorm = 358.4097, GNorm = 3.2063, lr_0 = 9.9710e-04
Validation auc = 0.708350
Epoch 4447
Loss = 5.0804e-02, PNorm = 358.4789, GNorm = 3.1059, lr_0 = 9.9710e-04
Validation auc = 0.702974
Epoch 4448
Loss = 6.8600e-02, PNorm = 358.5410, GNorm = 2.8483, lr_0 = 9.9710e-04
Validation auc = 0.697333
Epoch 4449
Loss = 1.5824e-02, PNorm = 358.5891, GNorm = 0.6860, lr_0 = 9.9710e-04
Loss = 3.4193e-02, PNorm = 358.6354, GNorm = 1.4158, lr_0 = 9.9709e-04
Validation auc = 0.688986
Epoch 4450
Loss = 2.3980e-02, PNorm = 358.6760, GNorm = 0.2003, lr_0 = 9.9709e-04
Validation auc = 0.692257
Epoch 4451
Loss = 2.8960e-02, PNorm = 358.7205, GNorm = 0.9850, lr_0 = 9.9709e-04
Validation auc = 0.695664
Epoch 4452
Loss = 5.0027e-02, PNorm = 358.7646, GNorm = 0.9389, lr_0 = 9.9709e-04
Validation auc = 0.709370
Epoch 4453
Loss = 3.3768e-02, PNorm = 358.8134, GNorm = 0.0681, lr_0 = 9.9709e-04
Validation auc = 0.713880
Epoch 4454
Loss = 1.1309e-02, PNorm = 358.8612, GNorm = 0.0866, lr_0 = 9.9709e-04
Validation auc = 0.721152
Epoch 4455
Loss = 4.6358e-02, PNorm = 358.9003, GNorm = 1.0105, lr_0 = 9.9709e-04
Validation auc = 0.729856
Epoch 4456
Loss = 4.7898e-02, PNorm = 358.9347, GNorm = 2.4901, lr_0 = 9.9709e-04
Validation auc = 0.731922
Epoch 4457
Loss = 7.9590e-03, PNorm = 358.9777, GNorm = 1.7354, lr_0 = 9.9709e-04
Validation auc = 0.726473
Epoch 4458
Loss = 2.7453e-02, PNorm = 359.0133, GNorm = 0.4555, lr_0 = 9.9709e-04
Validation auc = 0.723581
Epoch 4459
Loss = 1.7093e-02, PNorm = 359.0476, GNorm = 0.9519, lr_0 = 9.9709e-04
Loss = 1.3016e-02, PNorm = 359.0807, GNorm = 0.1452, lr_0 = 9.9709e-04
Validation auc = 0.723732
Epoch 4460
Loss = 2.9232e-02, PNorm = 359.1072, GNorm = 0.5478, lr_0 = 9.9709e-04
Validation auc = 0.720941
Epoch 4461
Loss = 1.8941e-03, PNorm = 359.1287, GNorm = 0.1098, lr_0 = 9.9709e-04
Validation auc = 0.720944
Epoch 4462
Loss = 1.9177e-02, PNorm = 359.1508, GNorm = 0.0083, lr_0 = 9.9708e-04
Validation auc = 0.719475
Epoch 4463
Loss = 1.5842e-02, PNorm = 359.1766, GNorm = 0.0950, lr_0 = 9.9708e-04
Validation auc = 0.718210
Epoch 4464
Loss = 9.2251e-03, PNorm = 359.2135, GNorm = 0.0165, lr_0 = 9.9708e-04
Validation auc = 0.720721
Epoch 4465
Loss = 5.2615e-02, PNorm = 359.2665, GNorm = 2.4303, lr_0 = 9.9708e-04
Validation auc = 0.722427
Epoch 4466
Loss = 3.4550e-02, PNorm = 359.3289, GNorm = 0.3367, lr_0 = 9.9708e-04
Validation auc = 0.709981
Epoch 4467
Loss = 1.8001e-02, PNorm = 359.3887, GNorm = 0.1831, lr_0 = 9.9708e-04
Validation auc = 0.709047
Epoch 4468
Loss = 1.0165e-02, PNorm = 359.4315, GNorm = 0.4357, lr_0 = 9.9708e-04
Validation auc = 0.710965
Epoch 4469
Loss = 4.4398e-03, PNorm = 359.4587, GNorm = 0.2162, lr_0 = 9.9708e-04
Loss = 4.0161e-02, PNorm = 359.4905, GNorm = 2.8153, lr_0 = 9.9708e-04
Validation auc = 0.704149
Epoch 4470
Loss = 4.3006e-02, PNorm = 359.5315, GNorm = 3.6966, lr_0 = 9.9708e-04
Validation auc = 0.704069
Epoch 4471
Loss = 5.6809e-03, PNorm = 359.5810, GNorm = 0.4043, lr_0 = 9.9708e-04
Validation auc = 0.704463
Epoch 4472
Loss = 2.5005e-02, PNorm = 359.6223, GNorm = 0.2497, lr_0 = 9.9708e-04
Validation auc = 0.710171
Epoch 4473
Loss = 7.5904e-03, PNorm = 359.6618, GNorm = 0.0526, lr_0 = 9.9708e-04
Validation auc = 0.705766
Epoch 4474
Loss = 5.2263e-02, PNorm = 359.6969, GNorm = 4.0934, lr_0 = 9.9708e-04
Validation auc = 0.691778
Epoch 4475
Loss = 1.1736e-02, PNorm = 359.7480, GNorm = 0.2318, lr_0 = 9.9708e-04
Validation auc = 0.685463
Epoch 4476
Loss = 9.1722e-03, PNorm = 359.7956, GNorm = 0.1456, lr_0 = 9.9707e-04
Validation auc = 0.689180
Epoch 4477
Loss = 1.7376e-02, PNorm = 359.8388, GNorm = 1.0664, lr_0 = 9.9707e-04
Validation auc = 0.701053
Epoch 4478
Loss = 4.4424e-02, PNorm = 359.8884, GNorm = 2.1752, lr_0 = 9.9707e-04
Validation auc = 0.707603
Epoch 4479
Loss = 3.9502e-03, PNorm = 359.9417, GNorm = 0.1026, lr_0 = 9.9707e-04
Loss = 2.2067e-02, PNorm = 359.9911, GNorm = 0.6335, lr_0 = 9.9707e-04
Validation auc = 0.710583
Epoch 4480
Loss = 2.4012e-02, PNorm = 360.0298, GNorm = 1.5068, lr_0 = 9.9707e-04
Validation auc = 0.709876
Epoch 4481
Loss = 1.8747e-02, PNorm = 360.0672, GNorm = 0.6305, lr_0 = 9.9707e-04
Validation auc = 0.710341
Epoch 4482
Loss = 6.1293e-02, PNorm = 360.1135, GNorm = 0.3107, lr_0 = 9.9707e-04
Validation auc = 0.709700
Epoch 4483
Loss = 4.7260e-02, PNorm = 360.1725, GNorm = 0.1364, lr_0 = 9.9707e-04
Validation auc = 0.712454
Epoch 4484
Loss = 1.7370e-02, PNorm = 360.2201, GNorm = 0.4071, lr_0 = 9.9707e-04
Validation auc = 0.715138
Epoch 4485
Loss = 1.1621e-02, PNorm = 360.2596, GNorm = 0.1324, lr_0 = 9.9707e-04
Validation auc = 0.712990
Epoch 4486
Loss = 4.1140e-03, PNorm = 360.2926, GNorm = 0.0633, lr_0 = 9.9707e-04
Validation auc = 0.707731
Epoch 4487
Loss = 1.2347e-03, PNorm = 360.3194, GNorm = 0.0136, lr_0 = 9.9707e-04
Validation auc = 0.699706
Epoch 4488
Loss = 7.2640e-03, PNorm = 360.3496, GNorm = 1.0715, lr_0 = 9.9707e-04
Validation auc = 0.683477
Epoch 4489
Loss = 2.1650e-03, PNorm = 360.3991, GNorm = 0.1088, lr_0 = 9.9707e-04
Loss = 5.2129e-02, PNorm = 360.4370, GNorm = 1.6303, lr_0 = 9.9706e-04
Validation auc = 0.677677
Epoch 4490
Loss = 3.4986e-02, PNorm = 360.4818, GNorm = 0.5283, lr_0 = 9.9706e-04
Validation auc = 0.677173
Epoch 4491
Loss = 2.6965e-02, PNorm = 360.5229, GNorm = 0.2872, lr_0 = 9.9706e-04
Validation auc = 0.680358
Epoch 4492
Loss = 8.8135e-03, PNorm = 360.5546, GNorm = 0.1974, lr_0 = 9.9706e-04
Validation auc = 0.682255
Epoch 4493
Loss = 3.2305e-02, PNorm = 360.5822, GNorm = 0.4605, lr_0 = 9.9706e-04
Validation auc = 0.688664
Epoch 4494
Loss = 3.3150e-02, PNorm = 360.6109, GNorm = 0.9024, lr_0 = 9.9706e-04
Validation auc = 0.694358
Epoch 4495
Loss = 2.8578e-02, PNorm = 360.6511, GNorm = 1.5891, lr_0 = 9.9706e-04
Validation auc = 0.690509
Epoch 4496
Loss = 6.4808e-02, PNorm = 360.6942, GNorm = 0.1930, lr_0 = 9.9706e-04
Validation auc = 0.690895
Epoch 4497
Loss = 1.7147e-02, PNorm = 360.7326, GNorm = 0.1000, lr_0 = 9.9706e-04
Validation auc = 0.688286
Epoch 4498
Loss = 8.3623e-03, PNorm = 360.7650, GNorm = 0.0678, lr_0 = 9.9706e-04
Validation auc = 0.680824
Epoch 4499
Loss = 4.3011e-02, PNorm = 360.8073, GNorm = 1.7173, lr_0 = 9.9706e-04
Loss = 1.4896e-02, PNorm = 360.8454, GNorm = 0.1075, lr_0 = 9.9706e-04
Validation auc = 0.681823
Epoch 4500
Loss = 8.8090e-03, PNorm = 360.8746, GNorm = 0.4275, lr_0 = 9.9706e-04
Validation auc = 0.684448
Epoch 4501
Loss = 4.4560e-02, PNorm = 360.9071, GNorm = 0.9601, lr_0 = 9.9706e-04
Validation auc = 0.674682
Epoch 4502
Loss = 7.5530e-03, PNorm = 360.9457, GNorm = 0.1926, lr_0 = 9.9705e-04
Validation auc = 0.673770
Epoch 4503
Loss = 4.5737e-02, PNorm = 360.9895, GNorm = 1.8612, lr_0 = 9.9705e-04
Validation auc = 0.686740
Epoch 4504
Loss = 3.4047e-02, PNorm = 361.0619, GNorm = 0.5919, lr_0 = 9.9705e-04
Validation auc = 0.689575
Epoch 4505
Loss = 2.3705e-02, PNorm = 361.1246, GNorm = 0.1278, lr_0 = 9.9705e-04
Validation auc = 0.699265
Epoch 4506
Loss = 1.2247e-02, PNorm = 361.1824, GNorm = 1.6859, lr_0 = 9.9705e-04
Validation auc = 0.698897
Epoch 4507
Loss = 1.8849e-01, PNorm = 361.2271, GNorm = 1.8145, lr_0 = 9.9705e-04
Validation auc = 0.705080
Epoch 4508
Loss = 2.6879e-02, PNorm = 361.2839, GNorm = 0.3735, lr_0 = 9.9705e-04
Validation auc = 0.704374
Epoch 4509
Loss = 6.7461e-02, PNorm = 361.3239, GNorm = 0.9721, lr_0 = 9.9705e-04
Loss = 3.5325e-02, PNorm = 361.3669, GNorm = 0.6982, lr_0 = 9.9705e-04
Validation auc = 0.707516
Epoch 4510
Loss = 2.8872e-02, PNorm = 361.4011, GNorm = 0.8353, lr_0 = 9.9705e-04
Validation auc = 0.709031
Epoch 4511
Loss = 4.9723e-02, PNorm = 361.4284, GNorm = 3.7473, lr_0 = 9.9705e-04
Validation auc = 0.705808
Epoch 4512
Loss = 1.7217e-02, PNorm = 361.4549, GNorm = 1.0723, lr_0 = 9.9705e-04
Validation auc = 0.700665
Epoch 4513
Loss = 2.2839e-02, PNorm = 361.4827, GNorm = 0.0701, lr_0 = 9.9705e-04
Validation auc = 0.716727
Epoch 4514
Loss = 7.9138e-03, PNorm = 361.5073, GNorm = 3.4996, lr_0 = 9.9705e-04
Validation auc = 0.725093
Epoch 4515
Loss = 1.4081e-02, PNorm = 361.5311, GNorm = 0.0890, lr_0 = 9.9705e-04
Validation auc = 0.717151
Epoch 4516
Loss = 3.5382e-02, PNorm = 361.5779, GNorm = 1.1507, lr_0 = 9.9704e-04
Validation auc = 0.713204
Epoch 4517
Loss = 2.9904e-02, PNorm = 361.6321, GNorm = 0.3958, lr_0 = 9.9704e-04
Validation auc = 0.697277
Epoch 4518
Loss = 8.4455e-02, PNorm = 361.6914, GNorm = 0.2313, lr_0 = 9.9704e-04
Validation auc = 0.693489
Epoch 4519
Loss = 1.3471e-02, PNorm = 361.7532, GNorm = 0.6164, lr_0 = 9.9704e-04
Loss = 4.4757e-02, PNorm = 361.8104, GNorm = 0.5691, lr_0 = 9.9704e-04
Validation auc = 0.701331
Epoch 4520
Loss = 3.4101e-02, PNorm = 361.8843, GNorm = 0.9258, lr_0 = 9.9704e-04
Validation auc = 0.694345
Epoch 4521
Loss = 1.8448e-02, PNorm = 361.9396, GNorm = 1.0538, lr_0 = 9.9704e-04
Validation auc = 0.693501
Epoch 4522
Loss = 1.2051e-01, PNorm = 362.0082, GNorm = 0.5856, lr_0 = 9.9704e-04
Validation auc = 0.707246
Epoch 4523
Loss = 2.5377e-02, PNorm = 362.0899, GNorm = 0.8454, lr_0 = 9.9704e-04
Validation auc = 0.711074
Epoch 4524
Loss = 9.3432e-02, PNorm = 362.1631, GNorm = 3.2824, lr_0 = 9.9704e-04
Validation auc = 0.709642
Epoch 4525
Loss = 2.9351e-02, PNorm = 362.2346, GNorm = 0.3602, lr_0 = 9.9704e-04
Validation auc = 0.717406
Epoch 4526
Loss = 3.1457e-02, PNorm = 362.2946, GNorm = 0.5243, lr_0 = 9.9704e-04
Validation auc = 0.719524
Epoch 4527
Loss = 4.7394e-02, PNorm = 362.3427, GNorm = 0.8551, lr_0 = 9.9704e-04
Validation auc = 0.722406
Epoch 4528
Loss = 5.1137e-02, PNorm = 362.3854, GNorm = 1.2166, lr_0 = 9.9704e-04
Validation auc = 0.727078
Epoch 4529
Loss = 9.8626e-03, PNorm = 362.4236, GNorm = 0.2855, lr_0 = 9.9703e-04
Loss = 1.5171e-02, PNorm = 362.4643, GNorm = 0.2195, lr_0 = 9.9703e-04
Validation auc = 0.722715
Epoch 4530
Loss = 2.9972e-02, PNorm = 362.4944, GNorm = 1.6639, lr_0 = 9.9703e-04
Validation auc = 0.725178
Epoch 4531
Loss = 2.0370e-02, PNorm = 362.5285, GNorm = 0.9739, lr_0 = 9.9703e-04
Validation auc = 0.722160
Epoch 4532
Loss = 1.3619e-02, PNorm = 362.5648, GNorm = 0.3874, lr_0 = 9.9703e-04
Validation auc = 0.714849
Epoch 4533
Loss = 3.3176e-02, PNorm = 362.6075, GNorm = 1.5668, lr_0 = 9.9703e-04
Validation auc = 0.708201
Epoch 4534
Loss = 8.7510e-03, PNorm = 362.6531, GNorm = 0.4309, lr_0 = 9.9703e-04
Validation auc = 0.709205
Epoch 4535
Loss = 2.8345e-02, PNorm = 362.6871, GNorm = 1.9344, lr_0 = 9.9703e-04
Validation auc = 0.712149
Epoch 4536
Loss = 1.9433e-03, PNorm = 362.7138, GNorm = 0.2636, lr_0 = 9.9703e-04
Validation auc = 0.711381
Epoch 4537
Loss = 1.6432e-02, PNorm = 362.7328, GNorm = 0.0996, lr_0 = 9.9703e-04
Validation auc = 0.711524
Epoch 4538
Loss = 4.2029e-02, PNorm = 362.7638, GNorm = 0.3320, lr_0 = 9.9703e-04
Validation auc = 0.710991
Epoch 4539
Loss = 2.4145e-02, PNorm = 362.8042, GNorm = 1.1826, lr_0 = 9.9703e-04
Loss = 3.5451e-02, PNorm = 362.8448, GNorm = 0.0578, lr_0 = 9.9703e-04
Validation auc = 0.709714
Epoch 4540
Loss = 3.0960e-02, PNorm = 362.8826, GNorm = 0.4127, lr_0 = 9.9703e-04
Validation auc = 0.716139
Epoch 4541
Loss = 2.5337e-02, PNorm = 362.9228, GNorm = 0.4224, lr_0 = 9.9703e-04
Validation auc = 0.718839
Epoch 4542
Loss = 1.5254e-02, PNorm = 362.9643, GNorm = 0.1672, lr_0 = 9.9702e-04
Validation auc = 0.719044
Epoch 4543
Loss = 3.2318e-03, PNorm = 362.9938, GNorm = 0.0351, lr_0 = 9.9702e-04
Validation auc = 0.717517
Epoch 4544
Loss = 5.5493e-02, PNorm = 363.0153, GNorm = 3.9691, lr_0 = 9.9702e-04
Validation auc = 0.715329
Epoch 4545
Loss = 6.7342e-03, PNorm = 363.0569, GNorm = 1.6070, lr_0 = 9.9702e-04
Validation auc = 0.708909
Epoch 4546
Loss = 1.8606e-02, PNorm = 363.0899, GNorm = 0.3672, lr_0 = 9.9702e-04
Validation auc = 0.712023
Epoch 4547
Loss = 4.5715e-03, PNorm = 363.1233, GNorm = 0.3476, lr_0 = 9.9702e-04
Validation auc = 0.707380
Epoch 4548
Loss = 6.2300e-03, PNorm = 363.1576, GNorm = 0.8219, lr_0 = 9.9702e-04
Validation auc = 0.699935
Epoch 4549
Loss = 1.5030e-03, PNorm = 363.2038, GNorm = 0.0562, lr_0 = 9.9702e-04
Loss = 1.7172e-02, PNorm = 363.2451, GNorm = 0.9279, lr_0 = 9.9702e-04
Validation auc = 0.700672
Epoch 4550
Loss = 1.1476e-02, PNorm = 363.2803, GNorm = 0.5317, lr_0 = 9.9702e-04
Validation auc = 0.704440
Epoch 4551
Loss = 2.5585e-02, PNorm = 363.3091, GNorm = 0.1855, lr_0 = 9.9702e-04
Validation auc = 0.703228
Epoch 4552
Loss = 6.6692e-02, PNorm = 363.3365, GNorm = 1.4671, lr_0 = 9.9702e-04
Validation auc = 0.707935
Epoch 4553
Loss = 4.3358e-02, PNorm = 363.3724, GNorm = 0.0277, lr_0 = 9.9702e-04
Validation auc = 0.706284
Epoch 4554
Loss = 2.8249e-02, PNorm = 363.4114, GNorm = 0.0830, lr_0 = 9.9702e-04
Validation auc = 0.706255
Epoch 4555
Loss = 8.2576e-03, PNorm = 363.4519, GNorm = 0.1219, lr_0 = 9.9701e-04
Validation auc = 0.702253
Epoch 4556
Loss = 5.7150e-02, PNorm = 363.4849, GNorm = 2.3478, lr_0 = 9.9701e-04
Validation auc = 0.706030
Epoch 4557
Loss = 4.5476e-03, PNorm = 363.5198, GNorm = 0.2390, lr_0 = 9.9701e-04
Validation auc = 0.707026
Epoch 4558
Loss = 5.9433e-02, PNorm = 363.5496, GNorm = 1.1811, lr_0 = 9.9701e-04
Validation auc = 0.709923
Epoch 4559
Loss = 2.4870e-02, PNorm = 363.5812, GNorm = 1.2120, lr_0 = 9.9701e-04
Loss = 1.7449e-02, PNorm = 363.6174, GNorm = 0.2715, lr_0 = 9.9701e-04
Validation auc = 0.710916
Epoch 4560
Loss = 2.7233e-02, PNorm = 363.6508, GNorm = 0.2854, lr_0 = 9.9701e-04
Validation auc = 0.708177
Epoch 4561
Loss = 2.2132e-02, PNorm = 363.6860, GNorm = 0.3018, lr_0 = 9.9701e-04
Validation auc = 0.702943
Epoch 4562
Loss = 4.0078e-02, PNorm = 363.7168, GNorm = 0.8030, lr_0 = 9.9701e-04
Validation auc = 0.696418
Epoch 4563
Loss = 4.7449e-02, PNorm = 363.7551, GNorm = 3.2368, lr_0 = 9.9701e-04
Validation auc = 0.695145
Epoch 4564
Loss = 3.9496e-02, PNorm = 363.7956, GNorm = 0.5265, lr_0 = 9.9701e-04
Validation auc = 0.704362
Epoch 4565
Loss = 9.9602e-03, PNorm = 363.8376, GNorm = 0.6544, lr_0 = 9.9701e-04
Validation auc = 0.705739
Epoch 4566
Loss = 2.1062e-02, PNorm = 363.8677, GNorm = 0.9635, lr_0 = 9.9701e-04
Validation auc = 0.711837
Epoch 4567
Loss = 1.8089e-02, PNorm = 363.8925, GNorm = 0.0495, lr_0 = 9.9701e-04
Validation auc = 0.714442
Epoch 4568
Loss = 7.2326e-03, PNorm = 363.9174, GNorm = 0.1331, lr_0 = 9.9701e-04
Validation auc = 0.713181
Epoch 4569
Loss = 6.7437e-03, PNorm = 363.9430, GNorm = 0.3618, lr_0 = 9.9700e-04
Loss = 1.7498e-02, PNorm = 363.9640, GNorm = 1.2717, lr_0 = 9.9700e-04
Validation auc = 0.711520
Epoch 4570
Loss = 5.4988e-03, PNorm = 363.9834, GNorm = 1.1370, lr_0 = 9.9700e-04
Validation auc = 0.709632
Epoch 4571
Loss = 2.5464e-02, PNorm = 363.9967, GNorm = 0.1753, lr_0 = 9.9700e-04
Validation auc = 0.709964
Epoch 4572
Loss = 5.2563e-02, PNorm = 364.0146, GNorm = 0.0492, lr_0 = 9.9700e-04
Validation auc = 0.714412
Epoch 4573
Loss = 2.3457e-02, PNorm = 364.0376, GNorm = 1.4848, lr_0 = 9.9700e-04
Validation auc = 0.712484
Epoch 4574
Loss = 2.9505e-02, PNorm = 364.0583, GNorm = 1.0310, lr_0 = 9.9700e-04
Validation auc = 0.712704
Epoch 4575
Loss = 3.5592e-02, PNorm = 364.0767, GNorm = 0.0461, lr_0 = 9.9700e-04
Validation auc = 0.713153
Epoch 4576
Loss = 1.3663e-02, PNorm = 364.1027, GNorm = 0.0907, lr_0 = 9.9700e-04
Validation auc = 0.717989
Epoch 4577
Loss = 4.2920e-02, PNorm = 364.1332, GNorm = 1.7938, lr_0 = 9.9700e-04
Validation auc = 0.720779
Epoch 4578
Loss = 2.5045e-02, PNorm = 364.1638, GNorm = 0.5573, lr_0 = 9.9700e-04
Validation auc = 0.722768
Epoch 4579
Loss = 8.1174e-03, PNorm = 364.1899, GNorm = 0.3427, lr_0 = 9.9700e-04
Loss = 3.4195e-02, PNorm = 364.2287, GNorm = 0.6830, lr_0 = 9.9700e-04
Validation auc = 0.732255
Epoch 4580
Loss = 2.2530e-02, PNorm = 364.2685, GNorm = 1.7635, lr_0 = 9.9700e-04
Validation auc = 0.736868
Epoch 4581
Loss = 3.7211e-02, PNorm = 364.3067, GNorm = 0.0850, lr_0 = 9.9700e-04
Validation auc = 0.738163
Epoch 4582
Loss = 2.5900e-02, PNorm = 364.3503, GNorm = 0.0914, lr_0 = 9.9699e-04
Validation auc = 0.734373
Epoch 4583
Loss = 3.7348e-02, PNorm = 364.3885, GNorm = 0.0598, lr_0 = 9.9699e-04
Validation auc = 0.723939
Epoch 4584
Loss = 3.0728e-02, PNorm = 364.4258, GNorm = 0.0783, lr_0 = 9.9699e-04
Validation auc = 0.719587
Epoch 4585
Loss = 4.5214e-02, PNorm = 364.4628, GNorm = 3.0426, lr_0 = 9.9699e-04
Validation auc = 0.708189
Epoch 4586
Loss = 1.6829e-02, PNorm = 364.5068, GNorm = 0.2420, lr_0 = 9.9699e-04
Validation auc = 0.708849
Epoch 4587
Loss = 1.4879e-02, PNorm = 364.5370, GNorm = 1.3729, lr_0 = 9.9699e-04
Validation auc = 0.713016
Epoch 4588
Loss = 4.6100e-03, PNorm = 364.5623, GNorm = 0.1570, lr_0 = 9.9699e-04
Validation auc = 0.710784
Epoch 4589
Loss = 4.1727e-02, PNorm = 364.5853, GNorm = 2.1401, lr_0 = 9.9699e-04
Loss = 1.4429e-02, PNorm = 364.6184, GNorm = 0.8816, lr_0 = 9.9699e-04
Validation auc = 0.711420
Epoch 4590
Loss = 1.6746e-02, PNorm = 364.6488, GNorm = 0.5841, lr_0 = 9.9699e-04
Validation auc = 0.712711
Epoch 4591
Loss = 7.4780e-03, PNorm = 364.6770, GNorm = 1.0076, lr_0 = 9.9699e-04
Validation auc = 0.714274
Epoch 4592
Loss = 1.8194e-02, PNorm = 364.7089, GNorm = 0.0356, lr_0 = 9.9699e-04
Validation auc = 0.711629
Epoch 4593
Loss = 3.6021e-02, PNorm = 364.7441, GNorm = 0.6419, lr_0 = 9.9699e-04
Validation auc = 0.706284
Epoch 4594
Loss = 2.8384e-02, PNorm = 364.7855, GNorm = 0.0927, lr_0 = 9.9699e-04
Validation auc = 0.700816
Epoch 4595
Loss = 4.6086e-03, PNorm = 364.8185, GNorm = 0.1395, lr_0 = 9.9698e-04
Validation auc = 0.700771
Epoch 4596
Loss = 7.4498e-03, PNorm = 364.8398, GNorm = 0.0757, lr_0 = 9.9698e-04
Validation auc = 0.695615
Epoch 4597
Loss = 7.0340e-03, PNorm = 364.8581, GNorm = 0.2650, lr_0 = 9.9698e-04
Validation auc = 0.693625
Epoch 4598
Loss = 3.4319e-02, PNorm = 364.8750, GNorm = 0.2779, lr_0 = 9.9698e-04
Validation auc = 0.696372
Epoch 4599
Loss = 5.1384e-04, PNorm = 364.8907, GNorm = 0.0240, lr_0 = 9.9698e-04
Loss = 6.0852e-02, PNorm = 364.9088, GNorm = 0.4556, lr_0 = 9.9698e-04
Validation auc = 0.694334
Epoch 4600
Loss = 2.6165e-02, PNorm = 364.9392, GNorm = 0.4921, lr_0 = 9.9698e-04
Validation auc = 0.699610
Epoch 4601
Loss = 2.6622e-02, PNorm = 364.9662, GNorm = 1.4016, lr_0 = 9.9698e-04
Validation auc = 0.704357
Epoch 4602
Loss = 1.4820e-02, PNorm = 364.9867, GNorm = 2.3751, lr_0 = 9.9698e-04
Validation auc = 0.706147
Epoch 4603
Loss = 2.6678e-02, PNorm = 365.0062, GNorm = 3.3497, lr_0 = 9.9698e-04
Validation auc = 0.697476
Epoch 4604
Loss = 1.0380e-02, PNorm = 365.0364, GNorm = 0.1057, lr_0 = 9.9698e-04
Validation auc = 0.692081
Epoch 4605
Loss = 9.7015e-03, PNorm = 365.0665, GNorm = 1.0540, lr_0 = 9.9698e-04
Validation auc = 0.694696
Epoch 4606
Loss = 1.2307e-02, PNorm = 365.0927, GNorm = 0.0398, lr_0 = 9.9698e-04
Validation auc = 0.694644
Epoch 4607
Loss = 4.2618e-03, PNorm = 365.1179, GNorm = 0.4639, lr_0 = 9.9698e-04
Validation auc = 0.691052
Epoch 4608
Loss = 4.3194e-03, PNorm = 365.1429, GNorm = 0.2562, lr_0 = 9.9698e-04
Validation auc = 0.685647
Epoch 4609
Loss = 2.2263e-03, PNorm = 365.1694, GNorm = 0.0968, lr_0 = 9.9697e-04
Loss = 2.8015e-02, PNorm = 365.2026, GNorm = 0.0367, lr_0 = 9.9697e-04
Validation auc = 0.692723
Epoch 4610
Loss = 1.8130e-02, PNorm = 365.2433, GNorm = 0.3258, lr_0 = 9.9697e-04
Validation auc = 0.698752
Epoch 4611
Loss = 3.8808e-02, PNorm = 365.2756, GNorm = 8.1704, lr_0 = 9.9697e-04
Validation auc = 0.701563
Epoch 4612
Loss = 5.2181e-02, PNorm = 365.3251, GNorm = 1.4923, lr_0 = 9.9697e-04
Validation auc = 0.700768
Epoch 4613
Loss = 1.9604e-02, PNorm = 365.3739, GNorm = 0.7350, lr_0 = 9.9697e-04
Validation auc = 0.702733
Epoch 4614
Loss = 1.1841e-02, PNorm = 365.4168, GNorm = 0.3593, lr_0 = 9.9697e-04
Validation auc = 0.707479
Epoch 4615
Loss = 7.8523e-03, PNorm = 365.4552, GNorm = 0.1033, lr_0 = 9.9697e-04
Validation auc = 0.706964
Epoch 4616
Loss = 3.0863e-02, PNorm = 365.4828, GNorm = 0.4940, lr_0 = 9.9697e-04
Validation auc = 0.708367
Epoch 4617
Loss = 3.5513e-02, PNorm = 365.5150, GNorm = 2.0031, lr_0 = 9.9697e-04
Validation auc = 0.719022
Epoch 4618
Loss = 4.5594e-02, PNorm = 365.5799, GNorm = 0.6167, lr_0 = 9.9697e-04
Validation auc = 0.718706
Epoch 4619
Loss = 7.4294e-02, PNorm = 365.6471, GNorm = 0.9700, lr_0 = 9.9697e-04
Loss = 3.5191e-02, PNorm = 365.7005, GNorm = 0.2280, lr_0 = 9.9697e-04
Validation auc = 0.713980
Epoch 4620
Loss = 1.6837e-02, PNorm = 365.7467, GNorm = 1.3368, lr_0 = 9.9697e-04
Validation auc = 0.716353
Epoch 4621
Loss = 2.4521e-02, PNorm = 365.7912, GNorm = 0.3148, lr_0 = 9.9696e-04
Validation auc = 0.717035
Epoch 4622
Loss = 8.8188e-03, PNorm = 365.8263, GNorm = 0.0874, lr_0 = 9.9696e-04
Validation auc = 0.716930
Epoch 4623
Loss = 8.1616e-02, PNorm = 365.8590, GNorm = 2.9205, lr_0 = 9.9696e-04
Validation auc = 0.719243
Epoch 4624
Loss = 1.1881e-02, PNorm = 365.9003, GNorm = 0.0227, lr_0 = 9.9696e-04
Validation auc = 0.715935
Epoch 4625
Loss = 2.6883e-02, PNorm = 365.9344, GNorm = 0.0355, lr_0 = 9.9696e-04
Validation auc = 0.714826
Epoch 4626
Loss = 3.3321e-02, PNorm = 365.9581, GNorm = 1.4163, lr_0 = 9.9696e-04
Validation auc = 0.714353
Epoch 4627
Loss = 8.3399e-03, PNorm = 365.9789, GNorm = 0.0641, lr_0 = 9.9696e-04
Validation auc = 0.712750
Epoch 4628
Loss = 9.2828e-02, PNorm = 366.0099, GNorm = 3.0107, lr_0 = 9.9696e-04
Validation auc = 0.713806
Epoch 4629
Loss = 6.0853e-03, PNorm = 366.0572, GNorm = 0.3048, lr_0 = 9.9696e-04
Loss = 1.9797e-02, PNorm = 366.1000, GNorm = 0.1782, lr_0 = 9.9696e-04
Validation auc = 0.710312
Epoch 4630
Loss = 3.7210e-02, PNorm = 366.1407, GNorm = 0.2740, lr_0 = 9.9696e-04
Validation auc = 0.707279
Epoch 4631
Loss = 9.4273e-03, PNorm = 366.1870, GNorm = 1.0580, lr_0 = 9.9696e-04
Validation auc = 0.708164
Epoch 4632
Loss = 2.1426e-02, PNorm = 366.2233, GNorm = 0.5491, lr_0 = 9.9696e-04
Validation auc = 0.702747
Epoch 4633
Loss = 7.2457e-03, PNorm = 366.2530, GNorm = 0.0876, lr_0 = 9.9696e-04
Validation auc = 0.703589
Epoch 4634
Loss = 3.5436e-02, PNorm = 366.2747, GNorm = 0.9090, lr_0 = 9.9696e-04
Validation auc = 0.697317
Epoch 4635
Loss = 2.2224e-02, PNorm = 366.3013, GNorm = 2.0506, lr_0 = 9.9695e-04
Validation auc = 0.693386
Epoch 4636
Loss = 8.1165e-03, PNorm = 366.3299, GNorm = 0.2953, lr_0 = 9.9695e-04
Validation auc = 0.693650
Epoch 4637
Loss = 4.5499e-03, PNorm = 366.3596, GNorm = 0.2935, lr_0 = 9.9695e-04
Validation auc = 0.700145
Epoch 4638
Loss = 2.3374e-03, PNorm = 366.3919, GNorm = 0.0314, lr_0 = 9.9695e-04
Validation auc = 0.702095
Epoch 4639
Loss = 1.7986e-02, PNorm = 366.4181, GNorm = 0.9970, lr_0 = 9.9695e-04
Loss = 8.1043e-03, PNorm = 366.4431, GNorm = 0.0523, lr_0 = 9.9695e-04
Validation auc = 0.704491
Epoch 4640
Loss = 1.8457e-02, PNorm = 366.4711, GNorm = 0.5766, lr_0 = 9.9695e-04
Validation auc = 0.708491
Epoch 4641
Loss = 1.5598e-02, PNorm = 366.5011, GNorm = 0.2947, lr_0 = 9.9695e-04
Validation auc = 0.709491
Epoch 4642
Loss = 1.8943e-02, PNorm = 366.5459, GNorm = 0.3838, lr_0 = 9.9695e-04
Validation auc = 0.708657
Epoch 4643
Loss = 6.9479e-02, PNorm = 366.5934, GNorm = 1.1547, lr_0 = 9.9695e-04
Validation auc = 0.708485
Epoch 4644
Loss = 8.9301e-03, PNorm = 366.6430, GNorm = 0.0620, lr_0 = 9.9695e-04
Validation auc = 0.704677
Epoch 4645
Loss = 2.2015e-02, PNorm = 366.6835, GNorm = 1.3123, lr_0 = 9.9695e-04
Validation auc = 0.692951
Epoch 4646
Loss = 1.0702e-01, PNorm = 366.7150, GNorm = 0.0783, lr_0 = 9.9695e-04
Validation auc = 0.692974
Epoch 4647
Loss = 2.8440e-02, PNorm = 366.7432, GNorm = 0.1964, lr_0 = 9.9695e-04
Validation auc = 0.692211
Epoch 4648
Loss = 5.2764e-02, PNorm = 366.7714, GNorm = 1.2210, lr_0 = 9.9694e-04
Validation auc = 0.691238
Epoch 4649
Loss = 2.0794e-03, PNorm = 366.8023, GNorm = 0.0814, lr_0 = 9.9694e-04
Loss = 2.9568e-02, PNorm = 366.8282, GNorm = 0.0826, lr_0 = 9.9694e-04
Validation auc = 0.696522
Epoch 4650
Loss = 7.4495e-03, PNorm = 366.8515, GNorm = 0.1525, lr_0 = 9.9694e-04
Validation auc = 0.698454
Epoch 4651
Loss = 1.3201e-02, PNorm = 366.8776, GNorm = 0.0412, lr_0 = 9.9694e-04
Validation auc = 0.699731
Epoch 4652
Loss = 3.2350e-02, PNorm = 366.9161, GNorm = 0.4970, lr_0 = 9.9694e-04
Validation auc = 0.690328
Epoch 4653
Loss = 3.0855e-02, PNorm = 366.9682, GNorm = 0.2547, lr_0 = 9.9694e-04
Validation auc = 0.699571
Epoch 4654
Loss = 2.4808e-02, PNorm = 367.0173, GNorm = 1.0375, lr_0 = 9.9694e-04
Validation auc = 0.706795
Epoch 4655
Loss = 1.6242e-02, PNorm = 367.0668, GNorm = 1.4377, lr_0 = 9.9694e-04
Validation auc = 0.713390
Epoch 4656
Loss = 1.2921e-02, PNorm = 367.1053, GNorm = 0.3267, lr_0 = 9.9694e-04
Validation auc = 0.716782
Epoch 4657
Loss = 3.5118e-02, PNorm = 367.1445, GNorm = 1.6426, lr_0 = 9.9694e-04
Validation auc = 0.716686
Epoch 4658
Loss = 3.5009e-02, PNorm = 367.1864, GNorm = 0.3002, lr_0 = 9.9694e-04
Validation auc = 0.721065
Epoch 4659
Loss = 5.0756e-03, PNorm = 367.2326, GNorm = 0.2948, lr_0 = 9.9694e-04
Loss = 2.7433e-02, PNorm = 367.2672, GNorm = 0.2042, lr_0 = 9.9694e-04
Validation auc = 0.714681
Epoch 4660
Loss = 3.1565e-02, PNorm = 367.3065, GNorm = 0.1610, lr_0 = 9.9694e-04
Validation auc = 0.710359
Epoch 4661
Loss = 1.8543e-02, PNorm = 367.3402, GNorm = 0.0527, lr_0 = 9.9693e-04
Validation auc = 0.704950
Epoch 4662
Loss = 2.9036e-02, PNorm = 367.3759, GNorm = 0.3133, lr_0 = 9.9693e-04
Validation auc = 0.716159
Epoch 4663
Loss = 1.7383e-02, PNorm = 367.4144, GNorm = 2.2892, lr_0 = 9.9693e-04
Validation auc = 0.714249
Epoch 4664
Loss = 2.2705e-02, PNorm = 367.4484, GNorm = 2.2672, lr_0 = 9.9693e-04
Validation auc = 0.707003
Epoch 4665
Loss = 3.7413e-02, PNorm = 367.4912, GNorm = 0.7683, lr_0 = 9.9693e-04
Validation auc = 0.692203
Epoch 4666
Loss = 1.4334e-02, PNorm = 367.5313, GNorm = 0.2827, lr_0 = 9.9693e-04
Validation auc = 0.689178
Epoch 4667
Loss = 6.3905e-03, PNorm = 367.5715, GNorm = 0.4805, lr_0 = 9.9693e-04
Validation auc = 0.709654
Epoch 4668
Loss = 2.0355e-02, PNorm = 367.6181, GNorm = 1.3706, lr_0 = 9.9693e-04
Validation auc = 0.726822
Epoch 4669
Loss = 8.0611e-02, PNorm = 367.6588, GNorm = 2.4052, lr_0 = 9.9693e-04
Loss = 3.6702e-02, PNorm = 367.6939, GNorm = 2.5589, lr_0 = 9.9693e-04
Validation auc = 0.725833
Epoch 4670
Loss = 2.0725e-02, PNorm = 367.7401, GNorm = 1.1482, lr_0 = 9.9693e-04
Validation auc = 0.724297
Epoch 4671
Loss = 3.6639e-02, PNorm = 367.7935, GNorm = 3.8825, lr_0 = 9.9693e-04
Validation auc = 0.706991
Epoch 4672
Loss = 3.8187e-02, PNorm = 367.8486, GNorm = 0.3036, lr_0 = 9.9693e-04
Validation auc = 0.702915
Epoch 4673
Loss = 2.6046e-02, PNorm = 367.8919, GNorm = 1.0314, lr_0 = 9.9693e-04
Validation auc = 0.704888
Epoch 4674
Loss = 3.6107e-02, PNorm = 367.9363, GNorm = 0.3079, lr_0 = 9.9692e-04
Validation auc = 0.708175
Epoch 4675
Loss = 3.5253e-02, PNorm = 367.9934, GNorm = 0.5114, lr_0 = 9.9692e-04
Validation auc = 0.705267
Epoch 4676
Loss = 4.6309e-02, PNorm = 368.0378, GNorm = 1.0026, lr_0 = 9.9692e-04
Validation auc = 0.701090
Epoch 4677
Loss = 9.4799e-03, PNorm = 368.0779, GNorm = 0.0604, lr_0 = 9.9692e-04
Validation auc = 0.698843
Epoch 4678
Loss = 2.4457e-02, PNorm = 368.1083, GNorm = 0.9309, lr_0 = 9.9692e-04
Validation auc = 0.698833
Epoch 4679
Loss = 4.6605e-03, PNorm = 368.1392, GNorm = 0.1735, lr_0 = 9.9692e-04
Loss = 3.1179e-02, PNorm = 368.1692, GNorm = 0.2553, lr_0 = 9.9692e-04
Validation auc = 0.700312
Epoch 4680
Loss = 2.1311e-02, PNorm = 368.1975, GNorm = 0.4662, lr_0 = 9.9692e-04
Validation auc = 0.695387
Epoch 4681
Loss = 3.2091e-02, PNorm = 368.2350, GNorm = 1.1023, lr_0 = 9.9692e-04
Validation auc = 0.692791
Epoch 4682
Loss = 1.1362e-02, PNorm = 368.2713, GNorm = 0.0654, lr_0 = 9.9692e-04
Validation auc = 0.690383
Epoch 4683
Loss = 8.2281e-03, PNorm = 368.3017, GNorm = 0.7428, lr_0 = 9.9692e-04
Validation auc = 0.693786
Epoch 4684
Loss = 6.9944e-02, PNorm = 368.3312, GNorm = 0.0490, lr_0 = 9.9692e-04
Validation auc = 0.697135
Epoch 4685
Loss = 1.7476e-02, PNorm = 368.3729, GNorm = 0.1589, lr_0 = 9.9692e-04
Validation auc = 0.705212
Epoch 4686
Loss = 8.0992e-03, PNorm = 368.4055, GNorm = 0.5815, lr_0 = 9.9692e-04
Validation auc = 0.706670
Epoch 4687
Loss = 4.4494e-03, PNorm = 368.4380, GNorm = 0.2574, lr_0 = 9.9692e-04
Validation auc = 0.702162
Epoch 4688
Loss = 1.2622e-02, PNorm = 368.4776, GNorm = 0.5074, lr_0 = 9.9691e-04
Validation auc = 0.701173
Epoch 4689
Loss = 2.9191e-02, PNorm = 368.5244, GNorm = 2.1593, lr_0 = 9.9691e-04
Loss = 4.1639e-02, PNorm = 368.5684, GNorm = 0.1858, lr_0 = 9.9691e-04
Validation auc = 0.698718
Epoch 4690
Loss = 5.7517e-02, PNorm = 368.6237, GNorm = 0.5172, lr_0 = 9.9691e-04
Validation auc = 0.693215
Epoch 4691
Loss = 4.7509e-02, PNorm = 368.6903, GNorm = 1.5800, lr_0 = 9.9691e-04
Validation auc = 0.691590
Epoch 4692
Loss = 7.4962e-02, PNorm = 368.7478, GNorm = 4.2447, lr_0 = 9.9691e-04
Validation auc = 0.687408
Epoch 4693
Loss = 2.2450e-02, PNorm = 368.8151, GNorm = 1.2042, lr_0 = 9.9691e-04
Validation auc = 0.680614
Epoch 4694
Loss = 3.1455e-02, PNorm = 368.8642, GNorm = 1.4105, lr_0 = 9.9691e-04
Validation auc = 0.679794
Epoch 4695
Loss = 4.7404e-02, PNorm = 368.9089, GNorm = 2.1807, lr_0 = 9.9691e-04
Validation auc = 0.691829
Epoch 4696
Loss = 2.7549e-03, PNorm = 368.9624, GNorm = 0.1539, lr_0 = 9.9691e-04
Validation auc = 0.699398
Epoch 4697
Loss = 3.5412e-02, PNorm = 368.9978, GNorm = 0.0297, lr_0 = 9.9691e-04
Validation auc = 0.702745
Epoch 4698
Loss = 5.2845e-03, PNorm = 369.0274, GNorm = 0.1837, lr_0 = 9.9691e-04
Validation auc = 0.702250
Epoch 4699
Loss = 1.5655e-02, PNorm = 369.0598, GNorm = 0.6242, lr_0 = 9.9691e-04
Loss = 1.7315e-02, PNorm = 369.0917, GNorm = 0.3125, lr_0 = 9.9691e-04
Validation auc = 0.699690
Epoch 4700
Loss = 9.0386e-03, PNorm = 369.1151, GNorm = 0.6954, lr_0 = 9.9691e-04
Validation auc = 0.699729
Epoch 4701
Loss = 7.9725e-03, PNorm = 369.1358, GNorm = 0.0971, lr_0 = 9.9690e-04
Validation auc = 0.699470
Epoch 4702
Loss = 6.6063e-03, PNorm = 369.1564, GNorm = 0.4697, lr_0 = 9.9690e-04
Validation auc = 0.698045
Epoch 4703
Loss = 8.5171e-03, PNorm = 369.1739, GNorm = 2.2556, lr_0 = 9.9690e-04
Validation auc = 0.696042
Epoch 4704
Loss = 4.2099e-03, PNorm = 369.1993, GNorm = 1.8294, lr_0 = 9.9690e-04
Validation auc = 0.699092
Epoch 4705
Loss = 2.8759e-02, PNorm = 369.2273, GNorm = 0.0175, lr_0 = 9.9690e-04
Validation auc = 0.706341
Epoch 4706
Loss = 2.4330e-02, PNorm = 369.2587, GNorm = 0.1395, lr_0 = 9.9690e-04
Validation auc = 0.708798
Epoch 4707
Loss = 1.6279e-03, PNorm = 369.3079, GNorm = 0.0409, lr_0 = 9.9690e-04
Validation auc = 0.707676
Epoch 4708
Loss = 1.8331e-03, PNorm = 369.3557, GNorm = 0.1354, lr_0 = 9.9690e-04
Validation auc = 0.702574
Epoch 4709
Loss = 7.2298e-04, PNorm = 369.4043, GNorm = 0.0704, lr_0 = 9.9690e-04
Loss = 1.0489e-02, PNorm = 369.4351, GNorm = 1.4118, lr_0 = 9.9690e-04
Validation auc = 0.698716
Epoch 4710
Loss = 4.6516e-02, PNorm = 369.4727, GNorm = 0.1300, lr_0 = 9.9690e-04
Validation auc = 0.695801
Epoch 4711
Loss = 2.0201e-02, PNorm = 369.5202, GNorm = 2.9419, lr_0 = 9.9690e-04
Validation auc = 0.690604
Epoch 4712
Loss = 7.9725e-03, PNorm = 369.5725, GNorm = 0.5311, lr_0 = 9.9690e-04
Validation auc = 0.681790
Epoch 4713
Loss = 2.0823e-02, PNorm = 369.6228, GNorm = 0.7035, lr_0 = 9.9690e-04
Validation auc = 0.686426
Epoch 4714
Loss = 8.9093e-03, PNorm = 369.6621, GNorm = 0.2079, lr_0 = 9.9689e-04
Validation auc = 0.689065
Epoch 4715
Loss = 3.8665e-02, PNorm = 369.6879, GNorm = 0.0278, lr_0 = 9.9689e-04
Validation auc = 0.693704
Epoch 4716
Loss = 1.1368e-02, PNorm = 369.7250, GNorm = 0.2335, lr_0 = 9.9689e-04
Validation auc = 0.693393
Epoch 4717
Loss = 6.9942e-02, PNorm = 369.7676, GNorm = 1.9966, lr_0 = 9.9689e-04
Validation auc = 0.696795
Epoch 4718
Loss = 5.4401e-03, PNorm = 369.8251, GNorm = 0.1345, lr_0 = 9.9689e-04
Validation auc = 0.705044
Epoch 4719
Loss = 4.5156e-04, PNorm = 369.8771, GNorm = 0.0205, lr_0 = 9.9689e-04
Loss = 2.7556e-02, PNorm = 369.9143, GNorm = 0.0617, lr_0 = 9.9689e-04
Validation auc = 0.713164
Epoch 4720
Loss = 3.8306e-02, PNorm = 369.9579, GNorm = 1.0040, lr_0 = 9.9689e-04
Validation auc = 0.710037
Epoch 4721
Loss = 3.2279e-02, PNorm = 370.0052, GNorm = 2.1585, lr_0 = 9.9689e-04
Validation auc = 0.709084
Epoch 4722
Loss = 1.8150e-02, PNorm = 370.0501, GNorm = 0.6820, lr_0 = 9.9689e-04
Validation auc = 0.711312
Epoch 4723
Loss = 1.1119e-02, PNorm = 370.0898, GNorm = 0.6152, lr_0 = 9.9689e-04
Validation auc = 0.715899
Epoch 4724
Loss = 1.2789e-02, PNorm = 370.1182, GNorm = 0.3241, lr_0 = 9.9689e-04
Validation auc = 0.720797
Epoch 4725
Loss = 3.9582e-02, PNorm = 370.1396, GNorm = 1.5191, lr_0 = 9.9689e-04
Validation auc = 0.720974
Epoch 4726
Loss = 1.4160e-02, PNorm = 370.1657, GNorm = 1.1565, lr_0 = 9.9689e-04
Validation auc = 0.713965
Epoch 4727
Loss = 3.4562e-02, PNorm = 370.2027, GNorm = 0.0474, lr_0 = 9.9689e-04
Validation auc = 0.709946
Epoch 4728
Loss = 1.6385e-03, PNorm = 370.2360, GNorm = 0.0532, lr_0 = 9.9688e-04
Validation auc = 0.707938
Epoch 4729
Loss = 6.7938e-03, PNorm = 370.2666, GNorm = 0.2228, lr_0 = 9.9688e-04
Loss = 3.2189e-02, PNorm = 370.2991, GNorm = 1.1384, lr_0 = 9.9688e-04
Validation auc = 0.709434
Epoch 4730
Loss = 2.4248e-02, PNorm = 370.3341, GNorm = 0.1733, lr_0 = 9.9688e-04
Validation auc = 0.708550
Epoch 4731
Loss = 2.9643e-02, PNorm = 370.3722, GNorm = 0.0413, lr_0 = 9.9688e-04
Validation auc = 0.710240
Epoch 4732
Loss = 1.7203e-02, PNorm = 370.4089, GNorm = 0.6596, lr_0 = 9.9688e-04
Validation auc = 0.710506
Epoch 4733
Loss = 1.2842e-02, PNorm = 370.4376, GNorm = 0.7203, lr_0 = 9.9688e-04
Validation auc = 0.709990
Epoch 4734
Loss = 1.6805e-02, PNorm = 370.4609, GNorm = 1.5011, lr_0 = 9.9688e-04
Validation auc = 0.711504
Epoch 4735
Loss = 1.4001e-02, PNorm = 370.4871, GNorm = 1.1676, lr_0 = 9.9688e-04
Validation auc = 0.712439
Epoch 4736
Loss = 3.3643e-02, PNorm = 370.5122, GNorm = 0.0760, lr_0 = 9.9688e-04
Validation auc = 0.714387
Epoch 4737
Loss = 7.0245e-02, PNorm = 370.5398, GNorm = 1.1890, lr_0 = 9.9688e-04
Validation auc = 0.720741
Epoch 4738
Loss = 6.5904e-03, PNorm = 370.5747, GNorm = 0.1059, lr_0 = 9.9688e-04
Validation auc = 0.723386
Epoch 4739
Loss = 2.1266e-02, PNorm = 370.6015, GNorm = 0.7946, lr_0 = 9.9688e-04
Loss = 1.9386e-02, PNorm = 370.6281, GNorm = 0.4342, lr_0 = 9.9688e-04
Validation auc = 0.719448
Epoch 4740
Loss = 6.6503e-03, PNorm = 370.6532, GNorm = 0.1182, lr_0 = 9.9687e-04
Validation auc = 0.720601
Epoch 4741
Loss = 1.5099e-02, PNorm = 370.6721, GNorm = 0.0687, lr_0 = 9.9687e-04
Validation auc = 0.717879
Epoch 4742
Loss = 1.1654e-02, PNorm = 370.6950, GNorm = 0.0197, lr_0 = 9.9687e-04
Validation auc = 0.723240
Epoch 4743
Loss = 1.0577e-02, PNorm = 370.7346, GNorm = 0.2209, lr_0 = 9.9687e-04
Validation auc = 0.729303
Epoch 4744
Loss = 1.0077e-02, PNorm = 370.7677, GNorm = 1.6696, lr_0 = 9.9687e-04
Validation auc = 0.720647
Epoch 4745
Loss = 3.1068e-02, PNorm = 370.7963, GNorm = 0.1760, lr_0 = 9.9687e-04
Validation auc = 0.718862
Epoch 4746
Loss = 1.6159e-02, PNorm = 370.8269, GNorm = 0.0611, lr_0 = 9.9687e-04
Validation auc = 0.711154
Epoch 4747
Loss = 3.9619e-02, PNorm = 370.8550, GNorm = 0.8008, lr_0 = 9.9687e-04
Validation auc = 0.707686
Epoch 4748
Loss = 1.6426e-03, PNorm = 370.8816, GNorm = 0.0280, lr_0 = 9.9687e-04
Validation auc = 0.708061
Epoch 4749
Loss = 7.8250e-03, PNorm = 370.9190, GNorm = 0.5073, lr_0 = 9.9687e-04
Loss = 1.8342e-02, PNorm = 370.9493, GNorm = 0.4564, lr_0 = 9.9687e-04
Validation auc = 0.712281
Epoch 4750
Loss = 4.3532e-03, PNorm = 370.9746, GNorm = 0.3218, lr_0 = 9.9687e-04
Validation auc = 0.712284
Epoch 4751
Loss = 7.7711e-02, PNorm = 371.0158, GNorm = 0.6030, lr_0 = 9.9687e-04
Validation auc = 0.709665
Epoch 4752
Loss = 3.1591e-02, PNorm = 371.0686, GNorm = 0.6530, lr_0 = 9.9687e-04
Validation auc = 0.706463
Epoch 4753
Loss = 3.0007e-02, PNorm = 371.1149, GNorm = 1.3884, lr_0 = 9.9687e-04
Validation auc = 0.706505
Epoch 4754
Loss = 4.9621e-02, PNorm = 371.1571, GNorm = 1.4081, lr_0 = 9.9686e-04
Validation auc = 0.710347
Epoch 4755
Loss = 5.9049e-02, PNorm = 371.1979, GNorm = 1.1201, lr_0 = 9.9686e-04
Validation auc = 0.715191
Epoch 4756
Loss = 2.8052e-02, PNorm = 371.2400, GNorm = 0.2146, lr_0 = 9.9686e-04
Validation auc = 0.716103
Epoch 4757
Loss = 3.0418e-02, PNorm = 371.2732, GNorm = 0.0959, lr_0 = 9.9686e-04
Validation auc = 0.715910
Epoch 4758
Loss = 5.0275e-02, PNorm = 371.3035, GNorm = 0.5126, lr_0 = 9.9686e-04
Validation auc = 0.716920
Epoch 4759
Loss = 1.6125e-02, PNorm = 371.3381, GNorm = 1.2563, lr_0 = 9.9686e-04
Loss = 1.4699e-02, PNorm = 371.3704, GNorm = 0.2707, lr_0 = 9.9686e-04
Validation auc = 0.712533
Epoch 4760
Loss = 4.5334e-02, PNorm = 371.3993, GNorm = 1.1737, lr_0 = 9.9686e-04
Validation auc = 0.710117
Epoch 4761
Loss = 3.8910e-02, PNorm = 371.4332, GNorm = 1.7458, lr_0 = 9.9686e-04
Validation auc = 0.705564
Epoch 4762
Loss = 1.0207e-02, PNorm = 371.4729, GNorm = 0.0876, lr_0 = 9.9686e-04
Validation auc = 0.703499
Epoch 4763
Loss = 4.8663e-02, PNorm = 371.5021, GNorm = 0.4694, lr_0 = 9.9686e-04
Validation auc = 0.697743
Epoch 4764
Loss = 1.8314e-02, PNorm = 371.5319, GNorm = 1.9749, lr_0 = 9.9686e-04
Validation auc = 0.698402
Epoch 4765
Loss = 2.1479e-02, PNorm = 371.5637, GNorm = 0.0685, lr_0 = 9.9686e-04
Validation auc = 0.695713
Epoch 4766
Loss = 6.1205e-03, PNorm = 371.5971, GNorm = 0.0713, lr_0 = 9.9686e-04
Validation auc = 0.693953
Epoch 4767
Loss = 2.7628e-03, PNorm = 371.6243, GNorm = 0.0188, lr_0 = 9.9685e-04
Validation auc = 0.695555
Epoch 4768
Loss = 2.4547e-03, PNorm = 371.6470, GNorm = 0.1456, lr_0 = 9.9685e-04
Validation auc = 0.701247
Epoch 4769
Loss = 7.1525e-04, PNorm = 371.6690, GNorm = 0.0332, lr_0 = 9.9685e-04
Loss = 2.9315e-02, PNorm = 371.6833, GNorm = 0.0448, lr_0 = 9.9685e-04
Validation auc = 0.702279
Epoch 4770
Loss = 8.8751e-03, PNorm = 371.7004, GNorm = 0.0503, lr_0 = 9.9685e-04
Validation auc = 0.704828
Epoch 4771
Loss = 3.4355e-02, PNorm = 371.7223, GNorm = 0.6901, lr_0 = 9.9685e-04
Validation auc = 0.701990
Epoch 4772
Loss = 1.7153e-02, PNorm = 371.7512, GNorm = 1.1813, lr_0 = 9.9685e-04
Validation auc = 0.693824
Epoch 4773
Loss = 5.9173e-03, PNorm = 371.7876, GNorm = 0.7559, lr_0 = 9.9685e-04
Validation auc = 0.691243
Epoch 4774
Loss = 3.8792e-02, PNorm = 371.8150, GNorm = 0.0535, lr_0 = 9.9685e-04
Validation auc = 0.691901
Epoch 4775
Loss = 1.7838e-02, PNorm = 371.8410, GNorm = 1.2857, lr_0 = 9.9685e-04
Validation auc = 0.685941
Epoch 4776
Loss = 1.3139e-02, PNorm = 371.8687, GNorm = 0.2213, lr_0 = 9.9685e-04
Validation auc = 0.685127
Epoch 4777
Loss = 2.6086e-03, PNorm = 371.8956, GNorm = 0.0745, lr_0 = 9.9685e-04
Validation auc = 0.690823
Epoch 4778
Loss = 3.8454e-03, PNorm = 371.9233, GNorm = 0.1223, lr_0 = 9.9685e-04
Validation auc = 0.692823
Epoch 4779
Loss = 1.9709e-03, PNorm = 371.9450, GNorm = 0.0672, lr_0 = 9.9685e-04
Loss = 8.7305e-03, PNorm = 371.9731, GNorm = 0.4298, lr_0 = 9.9685e-04
Validation auc = 0.695441
Epoch 4780
Loss = 1.1714e-02, PNorm = 371.9994, GNorm = 0.1108, lr_0 = 9.9684e-04
Validation auc = 0.698161
Epoch 4781
Loss = 2.0782e-02, PNorm = 372.0236, GNorm = 0.1801, lr_0 = 9.9684e-04
Validation auc = 0.700853
Epoch 4782
Loss = 2.8508e-02, PNorm = 372.0473, GNorm = 0.8203, lr_0 = 9.9684e-04
Validation auc = 0.703923
Epoch 4783
Loss = 1.6012e-02, PNorm = 372.0734, GNorm = 0.9009, lr_0 = 9.9684e-04
Validation auc = 0.707882
Epoch 4784
Loss = 6.7306e-03, PNorm = 372.0997, GNorm = 0.0385, lr_0 = 9.9684e-04
Validation auc = 0.709553
Epoch 4785
Loss = 4.0788e-02, PNorm = 372.1204, GNorm = 0.2441, lr_0 = 9.9684e-04
Validation auc = 0.707299
Epoch 4786
Loss = 9.3938e-04, PNorm = 372.1444, GNorm = 0.0267, lr_0 = 9.9684e-04
Validation auc = 0.704296
Epoch 4787
Loss = 4.0201e-03, PNorm = 372.1632, GNorm = 0.0556, lr_0 = 9.9684e-04
Validation auc = 0.705072
Epoch 4788
Loss = 1.6325e-02, PNorm = 372.1798, GNorm = 1.0510, lr_0 = 9.9684e-04
Validation auc = 0.705121
Epoch 4789
Loss = 1.7319e-02, PNorm = 372.1957, GNorm = 1.3528, lr_0 = 9.9684e-04
Loss = 2.0420e-02, PNorm = 372.2114, GNorm = 3.4135, lr_0 = 9.9684e-04
Validation auc = 0.708128
Epoch 4790
Loss = 1.0110e-02, PNorm = 372.2378, GNorm = 0.0460, lr_0 = 9.9684e-04
Validation auc = 0.706253
Epoch 4791
Loss = 4.5251e-02, PNorm = 372.2669, GNorm = 0.9800, lr_0 = 9.9684e-04
Validation auc = 0.701447
Epoch 4792
Loss = 1.6856e-02, PNorm = 372.3088, GNorm = 0.4125, lr_0 = 9.9684e-04
Validation auc = 0.697175
Epoch 4793
Loss = 4.1311e-02, PNorm = 372.3477, GNorm = 0.0587, lr_0 = 9.9684e-04
Validation auc = 0.697413
Epoch 4794
Loss = 9.3016e-03, PNorm = 372.3847, GNorm = 0.0774, lr_0 = 9.9683e-04
Validation auc = 0.706391
Epoch 4795
Loss = 3.6776e-02, PNorm = 372.4141, GNorm = 0.0325, lr_0 = 9.9683e-04
Validation auc = 0.706450
Epoch 4796
Loss = 5.1678e-03, PNorm = 372.4538, GNorm = 0.1567, lr_0 = 9.9683e-04
Validation auc = 0.695657
Epoch 4797
Loss = 1.3298e-02, PNorm = 372.4980, GNorm = 1.0357, lr_0 = 9.9683e-04
Validation auc = 0.691981
Epoch 4798
Loss = 6.0591e-03, PNorm = 372.5362, GNorm = 0.1733, lr_0 = 9.9683e-04
Validation auc = 0.691659
Epoch 4799
Loss = 4.1902e-02, PNorm = 372.5683, GNorm = 2.5851, lr_0 = 9.9683e-04
Loss = 2.8671e-02, PNorm = 372.6138, GNorm = 0.0657, lr_0 = 9.9683e-04
Validation auc = 0.695421
Epoch 4800
Loss = 1.3819e-02, PNorm = 372.6517, GNorm = 0.6688, lr_0 = 9.9683e-04
Validation auc = 0.699013
Epoch 4801
Loss = 2.3262e-02, PNorm = 372.6783, GNorm = 0.8538, lr_0 = 9.9683e-04
Validation auc = 0.699668
Epoch 4802
Loss = 6.5384e-02, PNorm = 372.7346, GNorm = 2.2622, lr_0 = 9.9683e-04
Validation auc = 0.693857
Epoch 4803
Loss = 1.3422e-02, PNorm = 372.8217, GNorm = 0.7640, lr_0 = 9.9683e-04
Validation auc = 0.687924
Epoch 4804
Loss = 4.8359e-02, PNorm = 372.8881, GNorm = 0.1979, lr_0 = 9.9683e-04
Validation auc = 0.689309
Epoch 4805
Loss = 2.4901e-02, PNorm = 372.9475, GNorm = 2.4919, lr_0 = 9.9683e-04
Validation auc = 0.688639
Epoch 4806
Loss = 3.0169e-03, PNorm = 373.0031, GNorm = 0.2096, lr_0 = 9.9683e-04
Validation auc = 0.686785
Epoch 4807
Loss = 4.7863e-02, PNorm = 373.0449, GNorm = 0.5294, lr_0 = 9.9682e-04
Validation auc = 0.683096
Epoch 4808
Loss = 3.0995e-02, PNorm = 373.0801, GNorm = 0.4087, lr_0 = 9.9682e-04
Validation auc = 0.696787
Epoch 4809
Loss = 7.4461e-03, PNorm = 373.1147, GNorm = 0.3031, lr_0 = 9.9682e-04
Loss = 2.7526e-02, PNorm = 373.1577, GNorm = 0.2490, lr_0 = 9.9682e-04
Validation auc = 0.705757
Epoch 4810
Loss = 1.0134e-02, PNorm = 373.1941, GNorm = 0.1051, lr_0 = 9.9682e-04
Validation auc = 0.708258
Epoch 4811
Loss = 9.3034e-03, PNorm = 373.2258, GNorm = 0.2854, lr_0 = 9.9682e-04
Validation auc = 0.704913
Epoch 4812
Loss = 4.5578e-02, PNorm = 373.2538, GNorm = 0.0387, lr_0 = 9.9682e-04
Validation auc = 0.694121
Epoch 4813
Loss = 2.2364e-02, PNorm = 373.3020, GNorm = 0.2472, lr_0 = 9.9682e-04
Validation auc = 0.681143
Epoch 4814
Loss = 1.2844e-02, PNorm = 373.3466, GNorm = 0.0162, lr_0 = 9.9682e-04
Validation auc = 0.678857
Epoch 4815
Loss = 5.7594e-02, PNorm = 373.3910, GNorm = 1.6045, lr_0 = 9.9682e-04
Validation auc = 0.679084
Epoch 4816
Loss = 1.5833e-02, PNorm = 373.4500, GNorm = 0.3804, lr_0 = 9.9682e-04
Validation auc = 0.677183
Epoch 4817
Loss = 1.3452e-02, PNorm = 373.5146, GNorm = 1.3903, lr_0 = 9.9682e-04
Validation auc = 0.672764
Epoch 4818
Loss = 5.0266e-03, PNorm = 373.5758, GNorm = 0.3337, lr_0 = 9.9682e-04
Validation auc = 0.675460
Epoch 4819
Loss = 4.1867e-03, PNorm = 373.6283, GNorm = 0.3166, lr_0 = 9.9682e-04
Loss = 4.1177e-02, PNorm = 373.6754, GNorm = 2.0474, lr_0 = 9.9682e-04
Validation auc = 0.682907
Epoch 4820
Loss = 3.9178e-02, PNorm = 373.7346, GNorm = 0.5946, lr_0 = 9.9681e-04
Validation auc = 0.692582
Epoch 4821
Loss = 2.8343e-02, PNorm = 373.7889, GNorm = 0.1322, lr_0 = 9.9681e-04
Validation auc = 0.693027
Epoch 4822
Loss = 3.3206e-02, PNorm = 373.8383, GNorm = 0.0505, lr_0 = 9.9681e-04
Validation auc = 0.705775
Epoch 4823
Loss = 7.6606e-03, PNorm = 373.8851, GNorm = 0.2315, lr_0 = 9.9681e-04
Validation auc = 0.710970
Epoch 4824
Loss = 5.2436e-02, PNorm = 373.9231, GNorm = 0.2704, lr_0 = 9.9681e-04
Validation auc = 0.712194
Epoch 4825
Loss = 1.2087e-02, PNorm = 373.9664, GNorm = 0.5011, lr_0 = 9.9681e-04
Validation auc = 0.713601
Epoch 4826
Loss = 5.4521e-03, PNorm = 374.0059, GNorm = 0.4463, lr_0 = 9.9681e-04
Validation auc = 0.716035
Epoch 4827
Loss = 1.0074e-02, PNorm = 374.0380, GNorm = 0.1724, lr_0 = 9.9681e-04
Validation auc = 0.716526
Epoch 4828
Loss = 4.2767e-03, PNorm = 374.0645, GNorm = 0.2769, lr_0 = 9.9681e-04
Validation auc = 0.719099
Epoch 4829
Loss = 1.0167e-02, PNorm = 374.0917, GNorm = 0.4591, lr_0 = 9.9681e-04
Loss = 7.3003e-02, PNorm = 374.1327, GNorm = 1.1325, lr_0 = 9.9681e-04
Validation auc = 0.726188
Epoch 4830
Loss = 3.7434e-02, PNorm = 374.1798, GNorm = 0.8285, lr_0 = 9.9681e-04
Validation auc = 0.726080
Epoch 4831
Loss = 2.6944e-02, PNorm = 374.2309, GNorm = 0.2331, lr_0 = 9.9681e-04
Validation auc = 0.725884
Epoch 4832
Loss = 1.8638e-02, PNorm = 374.2731, GNorm = 1.2559, lr_0 = 9.9681e-04
Validation auc = 0.727731
Epoch 4833
Loss = 2.0744e-02, PNorm = 374.3149, GNorm = 2.0831, lr_0 = 9.9680e-04
Validation auc = 0.721689
Epoch 4834
Loss = 8.6714e-02, PNorm = 374.3496, GNorm = 0.9303, lr_0 = 9.9680e-04
Validation auc = 0.723560
Epoch 4835
Loss = 1.4083e-02, PNorm = 374.3852, GNorm = 0.2220, lr_0 = 9.9680e-04
Validation auc = 0.722299
Epoch 4836
Loss = 4.2083e-02, PNorm = 374.4332, GNorm = 1.8304, lr_0 = 9.9680e-04
Validation auc = 0.715940
Epoch 4837
Loss = 1.1669e-02, PNorm = 374.4840, GNorm = 0.2201, lr_0 = 9.9680e-04
Validation auc = 0.711185
Epoch 4838
Loss = 4.8092e-03, PNorm = 374.5183, GNorm = 0.3106, lr_0 = 9.9680e-04
Validation auc = 0.708441
Epoch 4839
Loss = 1.7289e-03, PNorm = 374.5435, GNorm = 0.1645, lr_0 = 9.9680e-04
Loss = 3.5848e-03, PNorm = 374.5641, GNorm = 0.0120, lr_0 = 9.9680e-04
Validation auc = 0.709805
Epoch 4840
Loss = 1.6345e-02, PNorm = 374.5808, GNorm = 0.8172, lr_0 = 9.9680e-04
Validation auc = 0.707320
Epoch 4841
Loss = 3.6943e-02, PNorm = 374.6217, GNorm = 0.2136, lr_0 = 9.9680e-04
Validation auc = 0.702312
Epoch 4842
Loss = 1.6709e-02, PNorm = 374.6658, GNorm = 0.0949, lr_0 = 9.9680e-04
Validation auc = 0.697700
Epoch 4843
Loss = 1.0073e-02, PNorm = 374.6984, GNorm = 1.0836, lr_0 = 9.9680e-04
Validation auc = 0.695527
Epoch 4844
Loss = 4.1928e-02, PNorm = 374.7276, GNorm = 1.6801, lr_0 = 9.9680e-04
Validation auc = 0.694186
Epoch 4845
Loss = 2.1741e-02, PNorm = 374.7596, GNorm = 1.5232, lr_0 = 9.9680e-04
Validation auc = 0.696426
Epoch 4846
Loss = 2.0668e-02, PNorm = 374.7947, GNorm = 0.1108, lr_0 = 9.9680e-04
Validation auc = 0.703474
Epoch 4847
Loss = 8.2553e-03, PNorm = 374.8378, GNorm = 0.5567, lr_0 = 9.9679e-04
Validation auc = 0.708483
Epoch 4848
Loss = 3.8639e-03, PNorm = 374.8789, GNorm = 0.1371, lr_0 = 9.9679e-04
Validation auc = 0.707734
Epoch 4849
Loss = 2.6222e-02, PNorm = 374.9108, GNorm = 1.2934, lr_0 = 9.9679e-04
Loss = 2.9094e-02, PNorm = 374.9395, GNorm = 1.2817, lr_0 = 9.9679e-04
Validation auc = 0.706714
Epoch 4850
Loss = 2.1608e-02, PNorm = 374.9718, GNorm = 0.2145, lr_0 = 9.9679e-04
Validation auc = 0.707843
Epoch 4851
Loss = 3.2066e-02, PNorm = 375.0048, GNorm = 2.0887, lr_0 = 9.9679e-04
Validation auc = 0.701297
Epoch 4852
Loss = 6.3944e-02, PNorm = 375.0479, GNorm = 3.5680, lr_0 = 9.9679e-04
Validation auc = 0.700334
Epoch 4853
Loss = 1.4158e-02, PNorm = 375.0907, GNorm = 2.9128, lr_0 = 9.9679e-04
Validation auc = 0.704362
Epoch 4854
Loss = 1.2022e-01, PNorm = 375.1294, GNorm = 1.3709, lr_0 = 9.9679e-04
Validation auc = 0.704679
Epoch 4855
Loss = 1.4367e-02, PNorm = 375.1850, GNorm = 0.5445, lr_0 = 9.9679e-04
Validation auc = 0.704955
Epoch 4856
Loss = 8.8680e-03, PNorm = 375.2282, GNorm = 0.1563, lr_0 = 9.9679e-04
Validation auc = 0.709717
Epoch 4857
Loss = 1.3782e-02, PNorm = 375.2591, GNorm = 1.1745, lr_0 = 9.9679e-04
Validation auc = 0.716103
Epoch 4858
Loss = 4.6628e-02, PNorm = 375.2930, GNorm = 3.6598, lr_0 = 9.9679e-04
Validation auc = 0.719066
Epoch 4859
Loss = 2.2421e-03, PNorm = 375.3430, GNorm = 0.0773, lr_0 = 9.9679e-04
Loss = 2.9094e-02, PNorm = 375.3941, GNorm = 1.1692, lr_0 = 9.9678e-04
Validation auc = 0.720510
Epoch 4860
Loss = 2.4523e-02, PNorm = 375.4379, GNorm = 0.2318, lr_0 = 9.9678e-04
Validation auc = 0.715062
Epoch 4861
Loss = 1.1871e-02, PNorm = 375.4738, GNorm = 1.0993, lr_0 = 9.9678e-04
Validation auc = 0.714444
Epoch 4862
Loss = 3.1429e-02, PNorm = 375.5093, GNorm = 1.4175, lr_0 = 9.9678e-04
Validation auc = 0.720106
Epoch 4863
Loss = 3.7172e-02, PNorm = 375.5664, GNorm = 0.3832, lr_0 = 9.9678e-04
Validation auc = 0.702652
Epoch 4864
Loss = 2.5868e-02, PNorm = 375.6344, GNorm = 0.0305, lr_0 = 9.9678e-04
Validation auc = 0.693621
Epoch 4865
Loss = 3.4239e-02, PNorm = 375.7033, GNorm = 2.5283, lr_0 = 9.9678e-04
Validation auc = 0.700199
Epoch 4866
Loss = 2.6891e-02, PNorm = 375.7653, GNorm = 0.0880, lr_0 = 9.9678e-04
Validation auc = 0.707281
Epoch 4867
Loss = 5.2432e-02, PNorm = 375.8183, GNorm = 1.8821, lr_0 = 9.9678e-04
Validation auc = 0.705570
Epoch 4868
Loss = 1.5659e-02, PNorm = 375.8707, GNorm = 0.1484, lr_0 = 9.9678e-04
Validation auc = 0.700041
Epoch 4869
Loss = 9.4046e-03, PNorm = 375.9139, GNorm = 0.2312, lr_0 = 9.9678e-04
Loss = 3.0584e-02, PNorm = 375.9599, GNorm = 0.7972, lr_0 = 9.9678e-04
Validation auc = 0.697618
Epoch 4870
Loss = 9.4958e-03, PNorm = 376.0005, GNorm = 0.2559, lr_0 = 9.9678e-04
Validation auc = 0.694716
Epoch 4871
Loss = 2.0409e-02, PNorm = 376.0356, GNorm = 0.7029, lr_0 = 9.9678e-04
Validation auc = 0.694884
Epoch 4872
Loss = 3.2188e-02, PNorm = 376.0682, GNorm = 0.5131, lr_0 = 9.9678e-04
Validation auc = 0.700786
Epoch 4873
Loss = 1.6583e-02, PNorm = 376.1023, GNorm = 0.3313, lr_0 = 9.9677e-04
Validation auc = 0.703189
Epoch 4874
Loss = 4.8748e-02, PNorm = 376.1412, GNorm = 1.5133, lr_0 = 9.9677e-04
Validation auc = 0.698058
Epoch 4875
Loss = 7.7639e-03, PNorm = 376.1929, GNorm = 0.0914, lr_0 = 9.9677e-04
Validation auc = 0.697495
Epoch 4876
Loss = 3.0725e-02, PNorm = 376.2419, GNorm = 0.8773, lr_0 = 9.9677e-04
Validation auc = 0.698036
Epoch 4877
Loss = 3.1529e-02, PNorm = 376.2948, GNorm = 2.2717, lr_0 = 9.9677e-04
Validation auc = 0.696438
Epoch 4878
Loss = 3.4908e-03, PNorm = 376.3462, GNorm = 0.4131, lr_0 = 9.9677e-04
Validation auc = 0.704210
Epoch 4879
Loss = 5.7653e-03, PNorm = 376.3861, GNorm = 0.5511, lr_0 = 9.9677e-04
Loss = 3.0178e-02, PNorm = 376.4218, GNorm = 2.1545, lr_0 = 9.9677e-04
Validation auc = 0.712059
Epoch 4880
Loss = 2.2296e-02, PNorm = 376.4601, GNorm = 1.4087, lr_0 = 9.9677e-04
Validation auc = 0.714952
Epoch 4881
Loss = 3.5988e-02, PNorm = 376.5055, GNorm = 0.8480, lr_0 = 9.9677e-04
Validation auc = 0.715149
Epoch 4882
Loss = 3.8009e-02, PNorm = 376.5544, GNorm = 1.4595, lr_0 = 9.9677e-04
Validation auc = 0.706771
Epoch 4883
Loss = 2.8323e-02, PNorm = 376.5985, GNorm = 0.1377, lr_0 = 9.9677e-04
Validation auc = 0.706795
Epoch 4884
Loss = 1.9527e-02, PNorm = 376.6371, GNorm = 2.9326, lr_0 = 9.9677e-04
Validation auc = 0.705890
Epoch 4885
Loss = 7.8657e-02, PNorm = 376.6808, GNorm = 0.6320, lr_0 = 9.9677e-04
Validation auc = 0.708877
Epoch 4886
Loss = 8.6795e-02, PNorm = 376.7359, GNorm = 2.5067, lr_0 = 9.9677e-04
Validation auc = 0.705038
Epoch 4887
Loss = 3.7816e-02, PNorm = 376.7873, GNorm = 0.7014, lr_0 = 9.9676e-04
Validation auc = 0.698490
Epoch 4888
Loss = 7.0891e-03, PNorm = 376.8462, GNorm = 0.4560, lr_0 = 9.9676e-04
Validation auc = 0.696363
Epoch 4889
Loss = 2.4677e-03, PNorm = 376.8984, GNorm = 0.3467, lr_0 = 9.9676e-04
Loss = 4.1602e-02, PNorm = 376.9488, GNorm = 1.0148, lr_0 = 9.9676e-04
Validation auc = 0.705493
Epoch 4890
Loss = 4.6598e-02, PNorm = 377.0001, GNorm = 1.7013, lr_0 = 9.9676e-04
Validation auc = 0.705918
Epoch 4891
Loss = 2.8280e-02, PNorm = 377.0475, GNorm = 0.0946, lr_0 = 9.9676e-04
Validation auc = 0.699890
Epoch 4892
Loss = 1.4300e-02, PNorm = 377.0842, GNorm = 0.0691, lr_0 = 9.9676e-04
Validation auc = 0.700533
Epoch 4893
Loss = 2.9661e-02, PNorm = 377.1160, GNorm = 0.2260, lr_0 = 9.9676e-04
Validation auc = 0.709526
Epoch 4894
Loss = 1.1581e-02, PNorm = 377.1536, GNorm = 0.1373, lr_0 = 9.9676e-04
Validation auc = 0.714075
Epoch 4895
Loss = 1.8313e-02, PNorm = 377.1860, GNorm = 1.6781, lr_0 = 9.9676e-04
Validation auc = 0.713575
Epoch 4896
Loss = 2.9505e-02, PNorm = 377.2259, GNorm = 1.8766, lr_0 = 9.9676e-04
Validation auc = 0.711226
Epoch 4897
Loss = 3.4451e-03, PNorm = 377.2645, GNorm = 0.0374, lr_0 = 9.9676e-04
Validation auc = 0.708007
Epoch 4898
Loss = 3.8518e-03, PNorm = 377.2907, GNorm = 0.1111, lr_0 = 9.9676e-04
Validation auc = 0.710286
Epoch 4899
Loss = 1.2829e-03, PNorm = 377.3137, GNorm = 0.0531, lr_0 = 9.9676e-04
Loss = 5.9451e-02, PNorm = 377.3471, GNorm = 0.0668, lr_0 = 9.9675e-04
Validation auc = 0.709070
Epoch 4900
Loss = 3.8194e-02, PNorm = 377.3963, GNorm = 1.1028, lr_0 = 9.9675e-04
Validation auc = 0.701706
Epoch 4901
Loss = 2.2392e-02, PNorm = 377.4399, GNorm = 0.9731, lr_0 = 9.9675e-04
Validation auc = 0.696915
Epoch 4902
Loss = 2.8555e-02, PNorm = 377.4804, GNorm = 0.0567, lr_0 = 9.9675e-04
Validation auc = 0.696327
Epoch 4903
Loss = 5.4648e-02, PNorm = 377.5150, GNorm = 2.9117, lr_0 = 9.9675e-04
Validation auc = 0.701819
Epoch 4904
Loss = 2.2025e-02, PNorm = 377.5534, GNorm = 0.3350, lr_0 = 9.9675e-04
Validation auc = 0.704049
Epoch 4905
Loss = 8.2648e-03, PNorm = 377.5840, GNorm = 0.1247, lr_0 = 9.9675e-04
Validation auc = 0.705626
Epoch 4906
Loss = 1.6237e-02, PNorm = 377.6030, GNorm = 0.5569, lr_0 = 9.9675e-04
Validation auc = 0.704950
Epoch 4907
Loss = 2.4083e-03, PNorm = 377.6201, GNorm = 0.0284, lr_0 = 9.9675e-04
Validation auc = 0.703729
Epoch 4908
Loss = 4.7430e-02, PNorm = 377.6409, GNorm = 2.0461, lr_0 = 9.9675e-04
Validation auc = 0.703617
Epoch 4909
Loss = 1.9770e-03, PNorm = 377.6620, GNorm = 0.1213, lr_0 = 9.9675e-04
Loss = 9.9286e-03, PNorm = 377.6782, GNorm = 0.4715, lr_0 = 9.9675e-04
Validation auc = 0.704828
Epoch 4910
Loss = 4.6478e-02, PNorm = 377.7110, GNorm = 0.8295, lr_0 = 9.9675e-04
Validation auc = 0.701998
Epoch 4911
Loss = 2.0133e-02, PNorm = 377.7474, GNorm = 2.6145, lr_0 = 9.9675e-04
Validation auc = 0.701676
Epoch 4912
Loss = 9.6193e-03, PNorm = 377.7801, GNorm = 0.4437, lr_0 = 9.9675e-04
Validation auc = 0.704254
Epoch 4913
Loss = 2.3633e-02, PNorm = 377.8129, GNorm = 0.0146, lr_0 = 9.9674e-04
Validation auc = 0.698937
Epoch 4914
Loss = 5.9527e-03, PNorm = 377.8440, GNorm = 0.2742, lr_0 = 9.9674e-04
Validation auc = 0.702783
Epoch 4915
Loss = 1.5887e-02, PNorm = 377.8818, GNorm = 0.1114, lr_0 = 9.9674e-04
Validation auc = 0.699540
Epoch 4916
Loss = 4.9463e-02, PNorm = 377.9299, GNorm = 0.6816, lr_0 = 9.9674e-04
Validation auc = 0.700759
Epoch 4917
Loss = 6.7904e-02, PNorm = 377.9732, GNorm = 0.7720, lr_0 = 9.9674e-04
Validation auc = 0.703730
Epoch 4918
Loss = 2.8090e-02, PNorm = 378.0271, GNorm = 1.5482, lr_0 = 9.9674e-04
Validation auc = 0.703405
Epoch 4919
Loss = 3.5118e-03, PNorm = 378.0817, GNorm = 0.1347, lr_0 = 9.9674e-04
Loss = 1.7961e-02, PNorm = 378.1152, GNorm = 1.6122, lr_0 = 9.9674e-04
Validation auc = 0.704000
Epoch 4920
Loss = 1.4885e-02, PNorm = 378.1414, GNorm = 1.2962, lr_0 = 9.9674e-04
Validation auc = 0.703844
Epoch 4921
Loss = 2.3486e-02, PNorm = 378.1705, GNorm = 0.2995, lr_0 = 9.9674e-04
Validation auc = 0.702645
Epoch 4922
Loss = 5.0107e-02, PNorm = 378.2104, GNorm = 0.7296, lr_0 = 9.9674e-04
Validation auc = 0.692911
Epoch 4923
Loss = 1.7500e-02, PNorm = 378.2510, GNorm = 0.0393, lr_0 = 9.9674e-04
Validation auc = 0.691822
Epoch 4924
Loss = 2.5958e-02, PNorm = 378.2845, GNorm = 1.2458, lr_0 = 9.9674e-04
Validation auc = 0.697101
Epoch 4925
Loss = 3.8471e-02, PNorm = 378.3188, GNorm = 0.3314, lr_0 = 9.9674e-04
Validation auc = 0.693347
Epoch 4926
Loss = 4.5479e-02, PNorm = 378.3549, GNorm = 0.1201, lr_0 = 9.9673e-04
Validation auc = 0.691130
Epoch 4927
Loss = 3.7155e-02, PNorm = 378.3927, GNorm = 1.0287, lr_0 = 9.9673e-04
Validation auc = 0.693780
Epoch 4928
Loss = 3.2158e-02, PNorm = 378.4353, GNorm = 4.5358, lr_0 = 9.9673e-04
Validation auc = 0.694107
Epoch 4929
Loss = 5.9212e-02, PNorm = 378.4831, GNorm = 0.8143, lr_0 = 9.9673e-04
Loss = 2.0954e-02, PNorm = 378.5200, GNorm = 0.8863, lr_0 = 9.9673e-04
Validation auc = 0.698827
Epoch 4930
Loss = 1.1023e-02, PNorm = 378.5460, GNorm = 0.0355, lr_0 = 9.9673e-04
Validation auc = 0.698780
Epoch 4931
Loss = 3.0854e-02, PNorm = 378.5618, GNorm = 1.8465, lr_0 = 9.9673e-04
Validation auc = 0.693471
Epoch 4932
Loss = 2.5941e-02, PNorm = 378.5801, GNorm = 1.6770, lr_0 = 9.9673e-04
Validation auc = 0.691936
Epoch 4933
Loss = 1.0284e-02, PNorm = 378.5997, GNorm = 0.0506, lr_0 = 9.9673e-04
Validation auc = 0.689690
Epoch 4934
Loss = 3.3773e-03, PNorm = 378.6194, GNorm = 0.1401, lr_0 = 9.9673e-04
Validation auc = 0.688411
Epoch 4935
Loss = 9.8190e-03, PNorm = 378.6407, GNorm = 0.3571, lr_0 = 9.9673e-04
Validation auc = 0.687404
Epoch 4936
Loss = 3.0357e-02, PNorm = 378.6624, GNorm = 0.1146, lr_0 = 9.9673e-04
Validation auc = 0.686488
Epoch 4937
Loss = 3.7701e-02, PNorm = 378.6866, GNorm = 1.0141, lr_0 = 9.9673e-04
Validation auc = 0.687505
Epoch 4938
Loss = 1.1461e-02, PNorm = 378.7183, GNorm = 0.0792, lr_0 = 9.9673e-04
Validation auc = 0.681240
Epoch 4939
Loss = 2.3146e-03, PNorm = 378.7582, GNorm = 0.1237, lr_0 = 9.9673e-04
Loss = 3.0222e-02, PNorm = 378.7898, GNorm = 0.3112, lr_0 = 9.9672e-04
Validation auc = 0.680709
Epoch 4940
Loss = 8.6326e-03, PNorm = 378.8226, GNorm = 0.0763, lr_0 = 9.9672e-04
Validation auc = 0.683376
Epoch 4941
Loss = 2.5039e-02, PNorm = 378.8482, GNorm = 0.0694, lr_0 = 9.9672e-04
Validation auc = 0.680160
Epoch 4942
Loss = 2.3490e-02, PNorm = 378.8691, GNorm = 0.5772, lr_0 = 9.9672e-04
Validation auc = 0.680503
Epoch 4943
Loss = 2.9383e-02, PNorm = 378.8899, GNorm = 1.9786, lr_0 = 9.9672e-04
Validation auc = 0.685893
Epoch 4944
Loss = 3.3150e-02, PNorm = 378.9278, GNorm = 0.1733, lr_0 = 9.9672e-04
Validation auc = 0.690224
Epoch 4945
Loss = 6.8267e-03, PNorm = 378.9753, GNorm = 0.0330, lr_0 = 9.9672e-04
Validation auc = 0.695052
Epoch 4946
Loss = 7.2646e-03, PNorm = 379.0136, GNorm = 0.4432, lr_0 = 9.9672e-04
Validation auc = 0.703785
Epoch 4947
Loss = 2.3252e-02, PNorm = 379.0424, GNorm = 1.3402, lr_0 = 9.9672e-04
Validation auc = 0.707525
Epoch 4948
Loss = 2.2076e-01, PNorm = 379.0709, GNorm = 0.8068, lr_0 = 9.9672e-04
Validation auc = 0.698706
Epoch 4949
Loss = 3.8740e-02, PNorm = 379.1043, GNorm = 0.9963, lr_0 = 9.9672e-04
Loss = 3.8209e-02, PNorm = 379.1385, GNorm = 1.5297, lr_0 = 9.9672e-04
Validation auc = 0.697057
Epoch 4950
Loss = 1.6338e-02, PNorm = 379.1706, GNorm = 0.1225, lr_0 = 9.9672e-04
Validation auc = 0.698634
Epoch 4951
Loss = 7.2373e-03, PNorm = 379.1953, GNorm = 0.4269, lr_0 = 9.9672e-04
Validation auc = 0.698359
Epoch 4952
Loss = 3.6674e-03, PNorm = 379.2133, GNorm = 0.1293, lr_0 = 9.9671e-04
Validation auc = 0.698759
Epoch 4953
Loss = 1.1930e-02, PNorm = 379.2266, GNorm = 0.0408, lr_0 = 9.9671e-04
Validation auc = 0.702786
Epoch 4954
Loss = 1.5728e-02, PNorm = 379.2456, GNorm = 0.0136, lr_0 = 9.9671e-04
Validation auc = 0.703371
Epoch 4955
Loss = 7.3001e-03, PNorm = 379.2669, GNorm = 1.2292, lr_0 = 9.9671e-04
Validation auc = 0.704041
Epoch 4956
Loss = 3.4051e-03, PNorm = 379.2849, GNorm = 0.2237, lr_0 = 9.9671e-04
Validation auc = 0.703371
Epoch 4957
Loss = 1.7137e-03, PNorm = 379.2992, GNorm = 0.0492, lr_0 = 9.9671e-04
Validation auc = 0.707627
Epoch 4958
Loss = 3.2557e-02, PNorm = 379.3163, GNorm = 1.0127, lr_0 = 9.9671e-04
Validation auc = 0.706701
Epoch 4959
Loss = 4.2971e-04, PNorm = 379.3435, GNorm = 0.0264, lr_0 = 9.9671e-04
Loss = 4.0034e-02, PNorm = 379.3800, GNorm = 0.2409, lr_0 = 9.9671e-04
Validation auc = 0.701936
Epoch 4960
Loss = 2.6582e-02, PNorm = 379.4258, GNorm = 1.2797, lr_0 = 9.9671e-04
Validation auc = 0.702889
Epoch 4961
Loss = 1.1216e-02, PNorm = 379.4650, GNorm = 0.3059, lr_0 = 9.9671e-04
Validation auc = 0.701918
Epoch 4962
Loss = 9.3517e-03, PNorm = 379.4964, GNorm = 0.1886, lr_0 = 9.9671e-04
Validation auc = 0.709447
Epoch 4963
Loss = 9.6311e-03, PNorm = 379.5232, GNorm = 3.0789, lr_0 = 9.9671e-04
Validation auc = 0.715955
Epoch 4964
Loss = 2.4612e-02, PNorm = 379.5502, GNorm = 0.0367, lr_0 = 9.9671e-04
Validation auc = 0.717987
Epoch 4965
Loss = 5.0616e-02, PNorm = 379.5838, GNorm = 0.0042, lr_0 = 9.9671e-04
Validation auc = 0.713577
Epoch 4966
Loss = 1.3143e-02, PNorm = 379.6149, GNorm = 0.6361, lr_0 = 9.9670e-04
Validation auc = 0.712234
Epoch 4967
Loss = 1.3751e-02, PNorm = 379.6552, GNorm = 1.2202, lr_0 = 9.9670e-04
Validation auc = 0.711654
Epoch 4968
Loss = 2.2367e-02, PNorm = 379.6982, GNorm = 0.8112, lr_0 = 9.9670e-04
Validation auc = 0.705551
Epoch 4969
Loss = 1.4565e-02, PNorm = 379.7320, GNorm = 0.8212, lr_0 = 9.9670e-04
Loss = 7.5289e-03, PNorm = 379.7585, GNorm = 0.4033, lr_0 = 9.9670e-04
Validation auc = 0.699213
Epoch 4970
Loss = 2.4537e-02, PNorm = 379.7826, GNorm = 1.9956, lr_0 = 9.9670e-04
Validation auc = 0.696829
Epoch 4971
Loss = 3.0469e-02, PNorm = 379.8128, GNorm = 4.5483, lr_0 = 9.9670e-04
Validation auc = 0.700088
Epoch 4972
Loss = 8.3672e-03, PNorm = 379.8522, GNorm = 0.0381, lr_0 = 9.9670e-04
Validation auc = 0.706162
Epoch 4973
Loss = 3.4302e-02, PNorm = 379.8869, GNorm = 0.1097, lr_0 = 9.9670e-04
Validation auc = 0.711733
Epoch 4974
Loss = 4.8453e-02, PNorm = 379.9300, GNorm = 0.1801, lr_0 = 9.9670e-04
Validation auc = 0.709959
Epoch 4975
Loss = 3.2793e-02, PNorm = 379.9788, GNorm = 0.5656, lr_0 = 9.9670e-04
Validation auc = 0.709492
Epoch 4976
Loss = 2.7385e-03, PNorm = 380.0240, GNorm = 0.2093, lr_0 = 9.9670e-04
Validation auc = 0.713368
Epoch 4977
Loss = 2.7168e-02, PNorm = 380.0597, GNorm = 0.6048, lr_0 = 9.9670e-04
Validation auc = 0.719716
Epoch 4978
Loss = 1.9852e-02, PNorm = 380.1052, GNorm = 0.1899, lr_0 = 9.9670e-04
Validation auc = 0.725109
Epoch 4979
Loss = 8.9267e-04, PNorm = 380.1467, GNorm = 0.0735, lr_0 = 9.9670e-04
Loss = 4.8911e-02, PNorm = 380.1745, GNorm = 3.3217, lr_0 = 9.9669e-04
Validation auc = 0.728705
Epoch 4980
Loss = 2.6692e-02, PNorm = 380.2156, GNorm = 0.6222, lr_0 = 9.9669e-04
Validation auc = 0.720753
Epoch 4981
Loss = 1.8098e-02, PNorm = 380.2543, GNorm = 1.2295, lr_0 = 9.9669e-04
Validation auc = 0.715144
Epoch 4982
Loss = 1.9102e-02, PNorm = 380.2874, GNorm = 0.2236, lr_0 = 9.9669e-04
Validation auc = 0.714951
Epoch 4983
Loss = 1.5738e-02, PNorm = 380.3117, GNorm = 0.6488, lr_0 = 9.9669e-04
Validation auc = 0.719020
Epoch 4984
Loss = 4.9690e-03, PNorm = 380.3337, GNorm = 0.0936, lr_0 = 9.9669e-04
Validation auc = 0.720474
Epoch 4985
Loss = 2.2932e-02, PNorm = 380.3508, GNorm = 0.7447, lr_0 = 9.9669e-04
Validation auc = 0.716233
Epoch 4986
Loss = 4.0622e-03, PNorm = 380.3686, GNorm = 0.3139, lr_0 = 9.9669e-04
Validation auc = 0.717550
Epoch 4987
Loss = 1.5305e-02, PNorm = 380.3915, GNorm = 1.8810, lr_0 = 9.9669e-04
Validation auc = 0.719377
Epoch 4988
Loss = 1.9917e-02, PNorm = 380.4296, GNorm = 0.2358, lr_0 = 9.9669e-04
Validation auc = 0.719345
Epoch 4989
Loss = 1.5926e-04, PNorm = 380.4795, GNorm = 0.0085, lr_0 = 9.9669e-04
Loss = 2.7001e-02, PNorm = 380.5163, GNorm = 0.1102, lr_0 = 9.9669e-04
Validation auc = 0.719303
Epoch 4990
Loss = 1.6868e-02, PNorm = 380.5468, GNorm = 0.2369, lr_0 = 9.9669e-04
Validation auc = 0.713167
Epoch 4991
Loss = 1.1867e-02, PNorm = 380.5737, GNorm = 1.9955, lr_0 = 9.9669e-04
Validation auc = 0.710806
Epoch 4992
Loss = 1.4771e-02, PNorm = 380.6003, GNorm = 1.6084, lr_0 = 9.9668e-04
Validation auc = 0.712770
Epoch 4993
Loss = 4.7235e-02, PNorm = 380.6268, GNorm = 1.7468, lr_0 = 9.9668e-04
Validation auc = 0.715078
Epoch 4994
Loss = 5.7294e-03, PNorm = 380.6522, GNorm = 0.1589, lr_0 = 9.9668e-04
Validation auc = 0.715233
Epoch 4995
Loss = 1.0573e-02, PNorm = 380.6763, GNorm = 2.5128, lr_0 = 9.9668e-04
Validation auc = 0.721215
Epoch 4996
Loss = 1.8163e-02, PNorm = 380.7052, GNorm = 0.0781, lr_0 = 9.9668e-04
Validation auc = 0.729531
Epoch 4997
Loss = 1.0363e-02, PNorm = 380.7390, GNorm = 0.0355, lr_0 = 9.9668e-04
Validation auc = 0.734391
Epoch 4998
Loss = 1.1281e-02, PNorm = 380.7727, GNorm = 0.8428, lr_0 = 9.9668e-04
Validation auc = 0.733457
Epoch 4999
Loss = 1.6498e-02, PNorm = 380.8020, GNorm = 0.4439, lr_0 = 9.9668e-04
Loss = 4.4859e-02, PNorm = 380.8285, GNorm = 0.1542, lr_0 = 9.9668e-04
Validation auc = 0.725742
Epoch 5000
Loss = 1.4267e-02, PNorm = 380.8583, GNorm = 0.1239, lr_0 = 9.9668e-04
Validation auc = 0.722705
Epoch 5001
Loss = 2.1116e-02, PNorm = 380.8831, GNorm = 0.2622, lr_0 = 9.9668e-04
Validation auc = 0.718088
Epoch 5002
Loss = 6.8234e-03, PNorm = 380.9123, GNorm = 0.8405, lr_0 = 9.9668e-04
Validation auc = 0.712064
Epoch 5003
Loss = 1.5720e-02, PNorm = 380.9357, GNorm = 2.4665, lr_0 = 9.9668e-04
Validation auc = 0.707095
Epoch 5004
Loss = 4.9301e-03, PNorm = 380.9640, GNorm = 0.2153, lr_0 = 9.9668e-04
Validation auc = 0.714805
Epoch 5005
Loss = 1.1702e-02, PNorm = 380.9953, GNorm = 0.0099, lr_0 = 9.9668e-04
Validation auc = 0.716931
Epoch 5006
Loss = 3.3695e-04, PNorm = 381.0211, GNorm = 0.0091, lr_0 = 9.9667e-04
Validation auc = 0.715087
Epoch 5007
Loss = 4.0173e-02, PNorm = 381.0369, GNorm = 0.0112, lr_0 = 9.9667e-04
Validation auc = 0.709881
Epoch 5008
Loss = 1.1393e-02, PNorm = 381.0608, GNorm = 2.7313, lr_0 = 9.9667e-04
Validation auc = 0.707734
Epoch 5009
Loss = 1.4939e-02, PNorm = 381.0877, GNorm = 0.7745, lr_0 = 9.9667e-04
Loss = 2.4175e-02, PNorm = 381.1223, GNorm = 0.0178, lr_0 = 9.9667e-04
Validation auc = 0.708045
Epoch 5010
Loss = 2.9789e-02, PNorm = 381.1548, GNorm = 0.1026, lr_0 = 9.9667e-04
Validation auc = 0.709405
Epoch 5011
Loss = 1.9137e-02, PNorm = 381.2015, GNorm = 1.6749, lr_0 = 9.9667e-04
Validation auc = 0.702266
Epoch 5012
Loss = 5.6868e-02, PNorm = 381.2449, GNorm = 0.1027, lr_0 = 9.9667e-04
Validation auc = 0.704272
Epoch 5013
Loss = 2.1800e-02, PNorm = 381.2953, GNorm = 0.6756, lr_0 = 9.9667e-04
Validation auc = 0.709336
Epoch 5014
Loss = 8.6840e-03, PNorm = 381.3408, GNorm = 1.1988, lr_0 = 9.9667e-04
Validation auc = 0.714886
Epoch 5015
Loss = 7.7460e-02, PNorm = 381.3724, GNorm = 2.4556, lr_0 = 9.9667e-04
Validation auc = 0.706707
Epoch 5016
Loss = 1.1382e-02, PNorm = 381.4159, GNorm = 0.8758, lr_0 = 9.9667e-04
Validation auc = 0.701671
Epoch 5017
Loss = 7.2086e-02, PNorm = 381.4594, GNorm = 4.3729, lr_0 = 9.9667e-04
Validation auc = 0.695952
Epoch 5018
Loss = 6.5690e-03, PNorm = 381.5152, GNorm = 0.6443, lr_0 = 9.9667e-04
Validation auc = 0.694434
Epoch 5019
Loss = 4.2274e-03, PNorm = 381.5723, GNorm = 0.1512, lr_0 = 9.9666e-04
Loss = 1.5086e-02, PNorm = 381.6138, GNorm = 0.9516, lr_0 = 9.9666e-04
Validation auc = 0.698553
Epoch 5020
Loss = 6.2718e-02, PNorm = 381.6625, GNorm = 1.1914, lr_0 = 9.9666e-04
Validation auc = 0.696850
Epoch 5021
Loss = 1.1281e-02, PNorm = 381.7081, GNorm = 1.9708, lr_0 = 9.9666e-04
Validation auc = 0.693480
Epoch 5022
Loss = 7.8838e-02, PNorm = 381.7442, GNorm = 0.0903, lr_0 = 9.9666e-04
Validation auc = 0.700161
Epoch 5023
Loss = 1.4568e-02, PNorm = 381.7818, GNorm = 0.2285, lr_0 = 9.9666e-04
Validation auc = 0.697904
Epoch 5024
Loss = 3.8941e-02, PNorm = 381.8204, GNorm = 3.1845, lr_0 = 9.9666e-04
Validation auc = 0.692789
Epoch 5025
Loss = 1.6315e-02, PNorm = 381.8576, GNorm = 0.3681, lr_0 = 9.9666e-04
Validation auc = 0.691214
Epoch 5026
Loss = 2.3706e-02, PNorm = 381.8985, GNorm = 0.3501, lr_0 = 9.9666e-04
Validation auc = 0.697353
Epoch 5027
Loss = 6.8225e-02, PNorm = 381.9439, GNorm = 0.0365, lr_0 = 9.9666e-04
Validation auc = 0.694529
Epoch 5028
Loss = 1.5385e-02, PNorm = 381.9856, GNorm = 0.1406, lr_0 = 9.9666e-04
Validation auc = 0.684069
Epoch 5029
Loss = 5.7387e-03, PNorm = 382.0338, GNorm = 0.1943, lr_0 = 9.9666e-04
Loss = 2.3301e-02, PNorm = 382.0892, GNorm = 0.7362, lr_0 = 9.9666e-04
Validation auc = 0.684421
Epoch 5030
Loss = 7.8485e-02, PNorm = 382.1357, GNorm = 0.5435, lr_0 = 9.9666e-04
Validation auc = 0.687057
Epoch 5031
Loss = 4.4796e-02, PNorm = 382.1943, GNorm = 1.2643, lr_0 = 9.9666e-04
Validation auc = 0.679604
Epoch 5032
Loss = 1.3870e-02, PNorm = 382.2580, GNorm = 0.0579, lr_0 = 9.9665e-04
Validation auc = 0.672078
Epoch 5033
Loss = 1.2227e-02, PNorm = 382.3020, GNorm = 2.9016, lr_0 = 9.9665e-04
Validation auc = 0.671866
Epoch 5034
Loss = 1.5660e-02, PNorm = 382.3498, GNorm = 0.0316, lr_0 = 9.9665e-04
Validation auc = 0.669175
Epoch 5035
Loss = 1.8787e-02, PNorm = 382.3972, GNorm = 2.4546, lr_0 = 9.9665e-04
Validation auc = 0.664744
Epoch 5036
Loss = 1.2607e-02, PNorm = 382.4365, GNorm = 0.1850, lr_0 = 9.9665e-04
Validation auc = 0.662919
Epoch 5037
Loss = 7.6595e-03, PNorm = 382.4893, GNorm = 0.3779, lr_0 = 9.9665e-04
Validation auc = 0.667646
Epoch 5038
Loss = 9.3422e-03, PNorm = 382.5397, GNorm = 0.9645, lr_0 = 9.9665e-04
Validation auc = 0.680539
Epoch 5039
Loss = 1.3372e-01, PNorm = 382.5889, GNorm = 1.6161, lr_0 = 9.9665e-04
Loss = 3.9322e-02, PNorm = 382.6391, GNorm = 0.8690, lr_0 = 9.9665e-04
Validation auc = 0.695738
Epoch 5040
Loss = 3.9989e-02, PNorm = 382.6969, GNorm = 0.2733, lr_0 = 9.9665e-04
Validation auc = 0.700953
Epoch 5041
Loss = 2.2416e-02, PNorm = 382.7521, GNorm = 0.1547, lr_0 = 9.9665e-04
Validation auc = 0.699497
Epoch 5042
Loss = 2.6413e-02, PNorm = 382.7977, GNorm = 1.7173, lr_0 = 9.9665e-04
Validation auc = 0.695533
Epoch 5043
Loss = 3.6808e-02, PNorm = 382.8277, GNorm = 0.9677, lr_0 = 9.9665e-04
Validation auc = 0.691336
Epoch 5044
Loss = 2.8047e-02, PNorm = 382.8648, GNorm = 1.2888, lr_0 = 9.9665e-04
Validation auc = 0.689991
Epoch 5045
Loss = 4.2880e-02, PNorm = 382.9018, GNorm = 0.9244, lr_0 = 9.9664e-04
Validation auc = 0.690915
Epoch 5046
Loss = 1.6107e-02, PNorm = 382.9370, GNorm = 0.3644, lr_0 = 9.9664e-04
Validation auc = 0.690364
Epoch 5047
Loss = 1.1990e-02, PNorm = 382.9729, GNorm = 1.3529, lr_0 = 9.9664e-04
Validation auc = 0.687659
Epoch 5048
Loss = 6.7950e-02, PNorm = 383.0013, GNorm = 1.4336, lr_0 = 9.9664e-04
Validation auc = 0.690740
Epoch 5049
Loss = 2.7554e-02, PNorm = 383.0256, GNorm = 1.1640, lr_0 = 9.9664e-04
Loss = 2.5070e-02, PNorm = 383.0663, GNorm = 0.0889, lr_0 = 9.9664e-04
Validation auc = 0.680343
Epoch 5050
Loss = 2.1957e-02, PNorm = 383.1097, GNorm = 0.0946, lr_0 = 9.9664e-04
Validation auc = 0.678003
Epoch 5051
Loss = 1.4594e-02, PNorm = 383.1416, GNorm = 0.1479, lr_0 = 9.9664e-04
Validation auc = 0.677609
Epoch 5052
Loss = 2.7509e-02, PNorm = 383.1642, GNorm = 0.2506, lr_0 = 9.9664e-04
Validation auc = 0.666590
Epoch 5053
Loss = 2.1011e-02, PNorm = 383.1986, GNorm = 0.2786, lr_0 = 9.9664e-04
Validation auc = 0.663925
Epoch 5054
Loss = 6.0158e-02, PNorm = 383.2357, GNorm = 0.7124, lr_0 = 9.9664e-04
Validation auc = 0.667639
Epoch 5055
Loss = 3.6029e-02, PNorm = 383.2766, GNorm = 1.0289, lr_0 = 9.9664e-04
Validation auc = 0.656554
Epoch 5056
Loss = 8.3249e-03, PNorm = 383.3246, GNorm = 0.0443, lr_0 = 9.9664e-04
Validation auc = 0.643361
Epoch 5057
Loss = 4.4734e-02, PNorm = 383.3718, GNorm = 0.2603, lr_0 = 9.9664e-04
Validation auc = 0.640087
Epoch 5058
Loss = 3.8856e-02, PNorm = 383.4323, GNorm = 1.1357, lr_0 = 9.9664e-04
Validation auc = 0.637839
Epoch 5059
Loss = 7.6889e-03, PNorm = 383.5068, GNorm = 0.3958, lr_0 = 9.9663e-04
Loss = 2.2802e-02, PNorm = 383.5738, GNorm = 1.9310, lr_0 = 9.9663e-04
Validation auc = 0.643279
Epoch 5060
Loss = 4.8196e-02, PNorm = 383.6185, GNorm = 0.1945, lr_0 = 9.9663e-04
Validation auc = 0.652059
Epoch 5061
Loss = 3.6669e-02, PNorm = 383.6650, GNorm = 0.4051, lr_0 = 9.9663e-04
Validation auc = 0.655986
Epoch 5062
Loss = 2.0121e-02, PNorm = 383.7048, GNorm = 0.0599, lr_0 = 9.9663e-04
Validation auc = 0.666427
Epoch 5063
Loss = 3.5498e-02, PNorm = 383.7398, GNorm = 0.7300, lr_0 = 9.9663e-04
Validation auc = 0.675012
Epoch 5064
Loss = 1.4882e-02, PNorm = 383.7770, GNorm = 0.0775, lr_0 = 9.9663e-04
Validation auc = 0.680277
Epoch 5065
Loss = 2.4717e-02, PNorm = 383.8030, GNorm = 1.0473, lr_0 = 9.9663e-04
Validation auc = 0.686058
Epoch 5066
Loss = 9.2836e-02, PNorm = 383.8327, GNorm = 0.9956, lr_0 = 9.9663e-04
Validation auc = 0.686076
Epoch 5067
Loss = 2.7804e-02, PNorm = 383.8778, GNorm = 1.3550, lr_0 = 9.9663e-04
Validation auc = 0.689996
Epoch 5068
Loss = 2.5287e-02, PNorm = 383.9177, GNorm = 0.9763, lr_0 = 9.9663e-04
Validation auc = 0.690483
Epoch 5069
Loss = 1.6004e-03, PNorm = 383.9513, GNorm = 0.0487, lr_0 = 9.9663e-04
Loss = 3.5897e-02, PNorm = 383.9957, GNorm = 0.1174, lr_0 = 9.9663e-04
Validation auc = 0.688969
Epoch 5070
Loss = 4.9903e-02, PNorm = 384.0610, GNorm = 3.1786, lr_0 = 9.9663e-04
Validation auc = 0.697146
Epoch 5071
Loss = 4.3292e-02, PNorm = 384.1447, GNorm = 0.7219, lr_0 = 9.9663e-04
Validation auc = 0.695514
Epoch 5072
Loss = 3.9867e-02, PNorm = 384.2188, GNorm = 1.7296, lr_0 = 9.9662e-04
Validation auc = 0.694680
Epoch 5073
Loss = 2.1894e-02, PNorm = 384.2729, GNorm = 1.4251, lr_0 = 9.9662e-04
Validation auc = 0.700669
Epoch 5074
Loss = 7.9849e-03, PNorm = 384.3136, GNorm = 0.5283, lr_0 = 9.9662e-04
Validation auc = 0.698966
Epoch 5075
Loss = 2.8190e-02, PNorm = 384.3523, GNorm = 0.3672, lr_0 = 9.9662e-04
Validation auc = 0.686752
Epoch 5076
Loss = 2.6349e-02, PNorm = 384.3980, GNorm = 0.2224, lr_0 = 9.9662e-04
Validation auc = 0.689840
Epoch 5077
Loss = 3.6721e-02, PNorm = 384.4390, GNorm = 0.1804, lr_0 = 9.9662e-04
Validation auc = 0.693174
Epoch 5078
Loss = 3.8280e-02, PNorm = 384.4828, GNorm = 3.7160, lr_0 = 9.9662e-04
Validation auc = 0.692657
Epoch 5079
Loss = 3.8134e-02, PNorm = 384.5313, GNorm = 0.6811, lr_0 = 9.9662e-04
Loss = 4.7126e-02, PNorm = 384.5713, GNorm = 0.1970, lr_0 = 9.9662e-04
Validation auc = 0.693060
Epoch 5080
Loss = 6.5670e-02, PNorm = 384.6124, GNorm = 0.0691, lr_0 = 9.9662e-04
Validation auc = 0.702011
Epoch 5081
Loss = 1.4900e-02, PNorm = 384.6479, GNorm = 0.3530, lr_0 = 9.9662e-04
Validation auc = 0.711977
Epoch 5082
Loss = 1.5292e-02, PNorm = 384.6812, GNorm = 0.1132, lr_0 = 9.9662e-04
Validation auc = 0.716631
Epoch 5083
Loss = 2.4684e-02, PNorm = 384.7187, GNorm = 0.0745, lr_0 = 9.9662e-04
Validation auc = 0.720714
Epoch 5084
Loss = 5.5214e-02, PNorm = 384.7517, GNorm = 0.0670, lr_0 = 9.9662e-04
Validation auc = 0.723315
Epoch 5085
Loss = 4.6856e-02, PNorm = 384.7884, GNorm = 0.0519, lr_0 = 9.9661e-04
Validation auc = 0.725461
Epoch 5086
Loss = 2.8606e-02, PNorm = 384.8219, GNorm = 1.3889, lr_0 = 9.9661e-04
Validation auc = 0.726952
Epoch 5087
Loss = 6.0311e-02, PNorm = 384.8536, GNorm = 0.4362, lr_0 = 9.9661e-04
Validation auc = 0.722420
Epoch 5088
Loss = 6.7450e-03, PNorm = 384.9006, GNorm = 0.2470, lr_0 = 9.9661e-04
Validation auc = 0.721429
Epoch 5089
Loss = 6.2882e-03, PNorm = 384.9539, GNorm = 0.1648, lr_0 = 9.9661e-04
Loss = 2.9586e-02, PNorm = 384.9954, GNorm = 0.2032, lr_0 = 9.9661e-04
Validation auc = 0.715198
Epoch 5090
Loss = 1.7067e-02, PNorm = 385.0285, GNorm = 0.3614, lr_0 = 9.9661e-04
Validation auc = 0.713392
Epoch 5091
Loss = 2.4458e-02, PNorm = 385.0619, GNorm = 0.0191, lr_0 = 9.9661e-04
Validation auc = 0.709344
Epoch 5092
Loss = 3.7207e-02, PNorm = 385.0951, GNorm = 0.2085, lr_0 = 9.9661e-04
Validation auc = 0.702390
Epoch 5093
Loss = 6.7862e-02, PNorm = 385.1396, GNorm = 0.0429, lr_0 = 9.9661e-04
Validation auc = 0.686349
Epoch 5094
Loss = 5.5431e-02, PNorm = 385.1894, GNorm = 1.6769, lr_0 = 9.9661e-04
Validation auc = 0.682033
Epoch 5095
Loss = 4.3087e-02, PNorm = 385.2458, GNorm = 1.3177, lr_0 = 9.9661e-04
Validation auc = 0.685170
Epoch 5096
Loss = 3.6546e-02, PNorm = 385.2966, GNorm = 0.6091, lr_0 = 9.9661e-04
Validation auc = 0.688065
Epoch 5097
Loss = 5.4154e-02, PNorm = 385.3385, GNorm = 0.1609, lr_0 = 9.9661e-04
Validation auc = 0.699704
Epoch 5098
Loss = 2.7324e-02, PNorm = 385.3751, GNorm = 0.0492, lr_0 = 9.9661e-04
Validation auc = 0.700620
Epoch 5099
Loss = 4.1494e-03, PNorm = 385.4125, GNorm = 0.4654, lr_0 = 9.9660e-04
Loss = 3.5137e-02, PNorm = 385.4487, GNorm = 0.0523, lr_0 = 9.9660e-04
Validation auc = 0.698420
Epoch 5100
Loss = 3.5714e-02, PNorm = 385.4832, GNorm = 2.0885, lr_0 = 9.9660e-04
Validation auc = 0.697664
Epoch 5101
Loss = 3.2558e-02, PNorm = 385.5286, GNorm = 1.1715, lr_0 = 9.9660e-04
Validation auc = 0.693305
Epoch 5102
Loss = 2.0802e-02, PNorm = 385.5700, GNorm = 0.1995, lr_0 = 9.9660e-04
Validation auc = 0.688337
Epoch 5103
Loss = 1.6271e-02, PNorm = 385.6074, GNorm = 0.1921, lr_0 = 9.9660e-04
Validation auc = 0.691353
Epoch 5104
Loss = 6.7864e-02, PNorm = 385.6342, GNorm = 3.2908, lr_0 = 9.9660e-04
Validation auc = 0.699257
Epoch 5105
Loss = 6.0139e-02, PNorm = 385.6705, GNorm = 1.1367, lr_0 = 9.9660e-04
Validation auc = 0.706103
Epoch 5106
Loss = 1.7365e-02, PNorm = 385.7221, GNorm = 0.3282, lr_0 = 9.9660e-04
Validation auc = 0.709009
Epoch 5107
Loss = 1.3038e-02, PNorm = 385.7622, GNorm = 0.0724, lr_0 = 9.9660e-04
Validation auc = 0.708483
Epoch 5108
Loss = 6.8672e-04, PNorm = 385.7967, GNorm = 0.0209, lr_0 = 9.9660e-04
Validation auc = 0.713793
Epoch 5109
Loss = 1.3587e-03, PNorm = 385.8271, GNorm = 0.0417, lr_0 = 9.9660e-04
Loss = 1.9561e-02, PNorm = 385.8522, GNorm = 0.0329, lr_0 = 9.9660e-04
Validation auc = 0.717902
Epoch 5110
Loss = 2.2250e-02, PNorm = 385.8849, GNorm = 2.1732, lr_0 = 9.9660e-04
Validation auc = 0.720381
Epoch 5111
Loss = 1.9395e-02, PNorm = 385.9176, GNorm = 0.6008, lr_0 = 9.9659e-04
Validation auc = 0.717440
Epoch 5112
Loss = 3.4256e-02, PNorm = 385.9417, GNorm = 0.3699, lr_0 = 9.9659e-04
Validation auc = 0.720513
Epoch 5113
Loss = 1.0530e-02, PNorm = 385.9656, GNorm = 0.4506, lr_0 = 9.9659e-04
Validation auc = 0.721339
Epoch 5114
Loss = 4.2669e-02, PNorm = 385.9992, GNorm = 0.3207, lr_0 = 9.9659e-04
Validation auc = 0.707564
Epoch 5115
Loss = 4.1312e-02, PNorm = 386.0414, GNorm = 1.4054, lr_0 = 9.9659e-04
Validation auc = 0.699874
Epoch 5116
Loss = 2.8134e-02, PNorm = 386.0763, GNorm = 0.1935, lr_0 = 9.9659e-04
Validation auc = 0.694921
Epoch 5117
Loss = 1.1215e-02, PNorm = 386.1111, GNorm = 0.2724, lr_0 = 9.9659e-04
Validation auc = 0.693622
Epoch 5118
Loss = 2.0861e-03, PNorm = 386.1475, GNorm = 0.1532, lr_0 = 9.9659e-04
Validation auc = 0.694130
Epoch 5119
Loss = 1.7241e-03, PNorm = 386.1752, GNorm = 0.0747, lr_0 = 9.9659e-04
Loss = 3.1415e-02, PNorm = 386.1996, GNorm = 0.0089, lr_0 = 9.9659e-04
Validation auc = 0.684885
Epoch 5120
Loss = 2.4520e-02, PNorm = 386.2326, GNorm = 2.4226, lr_0 = 9.9659e-04
Validation auc = 0.687558
Epoch 5121
Loss = 3.9531e-02, PNorm = 386.2666, GNorm = 1.6936, lr_0 = 9.9659e-04
Validation auc = 0.692355
Epoch 5122
Loss = 1.0886e-02, PNorm = 386.3033, GNorm = 0.1166, lr_0 = 9.9659e-04
Validation auc = 0.693489
Epoch 5123
Loss = 5.0745e-02, PNorm = 386.3276, GNorm = 0.9632, lr_0 = 9.9659e-04
Validation auc = 0.694631
Epoch 5124
Loss = 1.5364e-02, PNorm = 386.3544, GNorm = 1.2222, lr_0 = 9.9659e-04
Validation auc = 0.695366
Epoch 5125
Loss = 7.8066e-02, PNorm = 386.3789, GNorm = 4.5594, lr_0 = 9.9658e-04
Validation auc = 0.696666
Epoch 5126
Loss = 1.8338e-02, PNorm = 386.4196, GNorm = 0.0823, lr_0 = 9.9658e-04
Validation auc = 0.700801
Epoch 5127
Loss = 1.7489e-02, PNorm = 386.4577, GNorm = 0.5348, lr_0 = 9.9658e-04
Validation auc = 0.705086
Epoch 5128
Loss = 7.4508e-02, PNorm = 386.4887, GNorm = 0.2066, lr_0 = 9.9658e-04
Validation auc = 0.710786
Epoch 5129
Loss = 3.0613e-03, PNorm = 386.5184, GNorm = 0.1571, lr_0 = 9.9658e-04
Loss = 2.3840e-02, PNorm = 386.5493, GNorm = 1.4980, lr_0 = 9.9658e-04
Validation auc = 0.711081
Epoch 5130
Loss = 2.1857e-02, PNorm = 386.5786, GNorm = 0.1886, lr_0 = 9.9658e-04
Validation auc = 0.710730
Epoch 5131
Loss = 3.9636e-02, PNorm = 386.6045, GNorm = 0.2037, lr_0 = 9.9658e-04
Validation auc = 0.705162
Epoch 5132
Loss = 4.9295e-02, PNorm = 386.6300, GNorm = 3.1079, lr_0 = 9.9658e-04
Validation auc = 0.701851
Epoch 5133
Loss = 2.0873e-02, PNorm = 386.6665, GNorm = 1.1662, lr_0 = 9.9658e-04
Validation auc = 0.696676
Epoch 5134
Loss = 5.9623e-03, PNorm = 386.7055, GNorm = 0.0730, lr_0 = 9.9658e-04
Validation auc = 0.697830
Epoch 5135
Loss = 6.1488e-02, PNorm = 386.7340, GNorm = 1.2479, lr_0 = 9.9658e-04
Validation auc = 0.699814
Epoch 5136
Loss = 8.0805e-04, PNorm = 386.7537, GNorm = 0.0261, lr_0 = 9.9658e-04
Validation auc = 0.701161
Epoch 5137
Loss = 4.9212e-03, PNorm = 386.7688, GNorm = 0.1262, lr_0 = 9.9658e-04
Validation auc = 0.703157
Epoch 5138
Loss = 1.0812e-02, PNorm = 386.7828, GNorm = 0.7761, lr_0 = 9.9657e-04
Validation auc = 0.705919
Epoch 5139
Loss = 9.8516e-02, PNorm = 386.8167, GNorm = 2.1186, lr_0 = 9.9657e-04
Loss = 9.3297e-03, PNorm = 386.8552, GNorm = 1.2691, lr_0 = 9.9657e-04
Validation auc = 0.708607
Epoch 5140
Loss = 3.0957e-02, PNorm = 386.8870, GNorm = 0.0311, lr_0 = 9.9657e-04
Validation auc = 0.708062
Epoch 5141
Loss = 2.6638e-02, PNorm = 386.9238, GNorm = 0.2840, lr_0 = 9.9657e-04
Validation auc = 0.706282
Epoch 5142
Loss = 1.6062e-02, PNorm = 386.9613, GNorm = 0.0150, lr_0 = 9.9657e-04
Validation auc = 0.706891
Epoch 5143
Loss = 4.3860e-02, PNorm = 386.9953, GNorm = 0.1899, lr_0 = 9.9657e-04
Validation auc = 0.711640
Epoch 5144
Loss = 5.3629e-03, PNorm = 387.0431, GNorm = 1.0235, lr_0 = 9.9657e-04
Validation auc = 0.713067
Epoch 5145
Loss = 4.6148e-02, PNorm = 387.0829, GNorm = 1.5915, lr_0 = 9.9657e-04
Validation auc = 0.716640
Epoch 5146
Loss = 1.3849e-02, PNorm = 387.1227, GNorm = 0.2133, lr_0 = 9.9657e-04
Validation auc = 0.708474
Epoch 5147
Loss = 5.2054e-02, PNorm = 387.1611, GNorm = 0.4052, lr_0 = 9.9657e-04
Validation auc = 0.691928
Epoch 5148
Loss = 1.0261e-02, PNorm = 387.2031, GNorm = 1.2580, lr_0 = 9.9657e-04
Validation auc = 0.685335
Epoch 5149
Loss = 2.5964e-03, PNorm = 387.2316, GNorm = 0.1058, lr_0 = 9.9657e-04
Loss = 2.2688e-02, PNorm = 387.2545, GNorm = 1.0611, lr_0 = 9.9657e-04
Validation auc = 0.682827
Epoch 5150
Loss = 5.8058e-02, PNorm = 387.2892, GNorm = 0.0577, lr_0 = 9.9657e-04
Validation auc = 0.682145
Epoch 5151
Loss = 8.7249e-02, PNorm = 387.3334, GNorm = 3.3701, lr_0 = 9.9656e-04
Validation auc = 0.683575
Epoch 5152
Loss = 3.3352e-02, PNorm = 387.3799, GNorm = 0.2962, lr_0 = 9.9656e-04
Validation auc = 0.685347
Epoch 5153
Loss = 2.8586e-02, PNorm = 387.4231, GNorm = 3.2105, lr_0 = 9.9656e-04
Validation auc = 0.684841
Epoch 5154
Loss = 2.9839e-03, PNorm = 387.4652, GNorm = 0.1834, lr_0 = 9.9656e-04
Validation auc = 0.691156
Epoch 5155
Loss = 9.8415e-03, PNorm = 387.5034, GNorm = 0.7445, lr_0 = 9.9656e-04
Validation auc = 0.700094
Epoch 5156
Loss = 2.3877e-02, PNorm = 387.5345, GNorm = 2.1760, lr_0 = 9.9656e-04
Validation auc = 0.704240
Epoch 5157
Loss = 4.3522e-02, PNorm = 387.5633, GNorm = 2.1039, lr_0 = 9.9656e-04
Validation auc = 0.692915
Epoch 5158
Loss = 5.3251e-03, PNorm = 387.5939, GNorm = 0.3711, lr_0 = 9.9656e-04
Validation auc = 0.685299
Epoch 5159
Loss = 9.8366e-04, PNorm = 387.6318, GNorm = 0.0379, lr_0 = 9.9656e-04
Loss = 4.4392e-02, PNorm = 387.6700, GNorm = 0.3318, lr_0 = 9.9656e-04
Validation auc = 0.687801
Epoch 5160
Loss = 2.8072e-02, PNorm = 387.7060, GNorm = 2.5306, lr_0 = 9.9656e-04
Validation auc = 0.685393
Epoch 5161
Loss = 2.3616e-02, PNorm = 387.7412, GNorm = 0.5670, lr_0 = 9.9656e-04
Validation auc = 0.673032
Epoch 5162
Loss = 9.1657e-03, PNorm = 387.7752, GNorm = 0.3583, lr_0 = 9.9656e-04
Validation auc = 0.673815
Epoch 5163
Loss = 2.9393e-02, PNorm = 387.8123, GNorm = 1.6182, lr_0 = 9.9656e-04
Validation auc = 0.676269
Epoch 5164
Loss = 4.3938e-03, PNorm = 387.8525, GNorm = 0.0203, lr_0 = 9.9656e-04
Validation auc = 0.676101
Epoch 5165
Loss = 5.2749e-03, PNorm = 387.8842, GNorm = 0.1251, lr_0 = 9.9655e-04
Validation auc = 0.676607
Epoch 5166
Loss = 1.2117e-02, PNorm = 387.9057, GNorm = 0.3457, lr_0 = 9.9655e-04
Validation auc = 0.671885
Epoch 5167
Loss = 1.0188e-03, PNorm = 387.9331, GNorm = 0.0275, lr_0 = 9.9655e-04
Validation auc = 0.674529
Epoch 5168
Loss = 2.0396e-02, PNorm = 387.9564, GNorm = 1.6085, lr_0 = 9.9655e-04
Validation auc = 0.683616
Epoch 5169
Loss = 8.2056e-03, PNorm = 387.9893, GNorm = 0.2780, lr_0 = 9.9655e-04
Loss = 2.2242e-02, PNorm = 388.0227, GNorm = 1.2737, lr_0 = 9.9655e-04
Validation auc = 0.687889
Epoch 5170
Loss = 3.5782e-02, PNorm = 388.0619, GNorm = 2.7898, lr_0 = 9.9655e-04
Validation auc = 0.688088
Epoch 5171
Loss = 1.4703e-02, PNorm = 388.1192, GNorm = 0.6614, lr_0 = 9.9655e-04
Validation auc = 0.679991
Epoch 5172
Loss = 8.5349e-03, PNorm = 388.1594, GNorm = 0.5919, lr_0 = 9.9655e-04
Validation auc = 0.681653
Epoch 5173
Loss = 4.0973e-02, PNorm = 388.1929, GNorm = 0.5005, lr_0 = 9.9655e-04
Validation auc = 0.681889
Epoch 5174
Loss = 1.2992e-02, PNorm = 388.2291, GNorm = 0.7231, lr_0 = 9.9655e-04
Validation auc = 0.675070
Epoch 5175
Loss = 8.1169e-03, PNorm = 388.2624, GNorm = 0.2167, lr_0 = 9.9655e-04
Validation auc = 0.669305
Epoch 5176
Loss = 9.2660e-02, PNorm = 388.2962, GNorm = 0.1946, lr_0 = 9.9655e-04
Validation auc = 0.667186
Epoch 5177
Loss = 5.0213e-02, PNorm = 388.3357, GNorm = 4.2947, lr_0 = 9.9655e-04
Validation auc = 0.661014
Epoch 5178
Loss = 2.8691e-02, PNorm = 388.3735, GNorm = 0.3708, lr_0 = 9.9654e-04
Validation auc = 0.651751
Epoch 5179
Loss = 3.4970e-03, PNorm = 388.4067, GNorm = 0.1185, lr_0 = 9.9654e-04
Loss = 1.1510e-02, PNorm = 388.4336, GNorm = 2.1701, lr_0 = 9.9654e-04
Validation auc = 0.648417
Epoch 5180
Loss = 4.3421e-02, PNorm = 388.4673, GNorm = 0.1219, lr_0 = 9.9654e-04
Validation auc = 0.655146
Epoch 5181
Loss = 1.0192e-02, PNorm = 388.4947, GNorm = 0.1839, lr_0 = 9.9654e-04
Validation auc = 0.660872
Epoch 5182
Loss = 2.0050e-02, PNorm = 388.5132, GNorm = 2.2681, lr_0 = 9.9654e-04
Validation auc = 0.665021
Epoch 5183
Loss = 2.0812e-02, PNorm = 388.5380, GNorm = 0.1592, lr_0 = 9.9654e-04
Validation auc = 0.666683
Epoch 5184
Loss = 1.7912e-02, PNorm = 388.5650, GNorm = 0.0371, lr_0 = 9.9654e-04
Validation auc = 0.661124
Epoch 5185
Loss = 1.3917e-02, PNorm = 388.5910, GNorm = 0.8079, lr_0 = 9.9654e-04
Validation auc = 0.666204
Epoch 5186
Loss = 5.8602e-03, PNorm = 388.6209, GNorm = 0.0505, lr_0 = 9.9654e-04
Validation auc = 0.670785
Epoch 5187
Loss = 2.9086e-01, PNorm = 388.6464, GNorm = 6.8427, lr_0 = 9.9654e-04
Validation auc = 0.678253
Epoch 5188
Loss = 1.0693e-01, PNorm = 388.7004, GNorm = 5.1639, lr_0 = 9.9654e-04
Validation auc = 0.691706
Epoch 5189
Loss = 4.5508e-02, PNorm = 388.7788, GNorm = 2.1607, lr_0 = 9.9654e-04
Loss = 6.6681e-02, PNorm = 388.8570, GNorm = 0.2121, lr_0 = 9.9654e-04
Validation auc = 0.694358
Epoch 5190
Loss = 5.0561e-02, PNorm = 388.9204, GNorm = 0.2378, lr_0 = 9.9654e-04
Validation auc = 0.691664
Epoch 5191
Loss = 2.3406e-02, PNorm = 388.9776, GNorm = 0.6093, lr_0 = 9.9653e-04
Validation auc = 0.682792
Epoch 5192
Loss = 6.0248e-02, PNorm = 389.0186, GNorm = 2.2713, lr_0 = 9.9653e-04
Validation auc = 0.681397
Epoch 5193
Loss = 3.2195e-02, PNorm = 389.0641, GNorm = 0.0903, lr_0 = 9.9653e-04
Validation auc = 0.686266
Epoch 5194
Loss = 1.5877e-02, PNorm = 389.1120, GNorm = 2.6653, lr_0 = 9.9653e-04
Validation auc = 0.689296
Epoch 5195
Loss = 1.8724e-02, PNorm = 389.1598, GNorm = 1.8370, lr_0 = 9.9653e-04
Validation auc = 0.687982
Epoch 5196
Loss = 2.4424e-02, PNorm = 389.1992, GNorm = 0.5540, lr_0 = 9.9653e-04
Validation auc = 0.695887
Epoch 5197
Loss = 5.6322e-02, PNorm = 389.2294, GNorm = 0.1543, lr_0 = 9.9653e-04
Validation auc = 0.696425
Epoch 5198
Loss = 3.1297e-03, PNorm = 389.2625, GNorm = 0.2915, lr_0 = 9.9653e-04
Validation auc = 0.695467
Epoch 5199
Loss = 3.1453e-03, PNorm = 389.2854, GNorm = 0.0976, lr_0 = 9.9653e-04
Loss = 1.7590e-02, PNorm = 389.3029, GNorm = 0.0658, lr_0 = 9.9653e-04
Validation auc = 0.696583
Epoch 5200
Loss = 1.4228e-02, PNorm = 389.3227, GNorm = 0.6154, lr_0 = 9.9653e-04
Validation auc = 0.706506
Epoch 5201
Loss = 2.4040e-02, PNorm = 389.3500, GNorm = 2.8282, lr_0 = 9.9653e-04
Validation auc = 0.706896
Epoch 5202
Loss = 1.4499e-02, PNorm = 389.3840, GNorm = 1.1516, lr_0 = 9.9653e-04
Validation auc = 0.707555
Epoch 5203
Loss = 3.5327e-02, PNorm = 389.4236, GNorm = 1.9800, lr_0 = 9.9653e-04
Validation auc = 0.704659
Epoch 5204
Loss = 3.0140e-02, PNorm = 389.4695, GNorm = 1.5189, lr_0 = 9.9652e-04
Validation auc = 0.702871
Epoch 5205
Loss = 4.7317e-03, PNorm = 389.5113, GNorm = 0.3103, lr_0 = 9.9652e-04
Validation auc = 0.703975
Epoch 5206
Loss = 6.4983e-03, PNorm = 389.5391, GNorm = 0.6708, lr_0 = 9.9652e-04
Validation auc = 0.702382
Epoch 5207
Loss = 5.4905e-02, PNorm = 389.5602, GNorm = 0.2159, lr_0 = 9.9652e-04
Validation auc = 0.704471
Epoch 5208
Loss = 3.4931e-03, PNorm = 389.5865, GNorm = 0.1336, lr_0 = 9.9652e-04
Validation auc = 0.705520
Epoch 5209
Loss = 3.5328e-03, PNorm = 389.6192, GNorm = 0.1159, lr_0 = 9.9652e-04
Loss = 3.5899e-02, PNorm = 389.6431, GNorm = 0.2450, lr_0 = 9.9652e-04
Validation auc = 0.701906
Epoch 5210
Loss = 2.3742e-02, PNorm = 389.6738, GNorm = 0.2850, lr_0 = 9.9652e-04
Validation auc = 0.704216
Epoch 5211
Loss = 1.1931e-02, PNorm = 389.6991, GNorm = 1.0171, lr_0 = 9.9652e-04
Validation auc = 0.704749
Epoch 5212
Loss = 1.3249e-02, PNorm = 389.7227, GNorm = 0.0809, lr_0 = 9.9652e-04
Validation auc = 0.708023
Epoch 5213
Loss = 1.4038e-02, PNorm = 389.7502, GNorm = 0.2829, lr_0 = 9.9652e-04
Validation auc = 0.714991
Epoch 5214
Loss = 6.2157e-02, PNorm = 389.7744, GNorm = 1.4468, lr_0 = 9.9652e-04
Validation auc = 0.714400
Epoch 5215
Loss = 2.8545e-02, PNorm = 389.7982, GNorm = 2.1126, lr_0 = 9.9652e-04
Validation auc = 0.706869
Epoch 5216
Loss = 1.6921e-02, PNorm = 389.8271, GNorm = 0.6885, lr_0 = 9.9652e-04
Validation auc = 0.705050
Epoch 5217
Loss = 3.5150e-02, PNorm = 389.8539, GNorm = 0.1098, lr_0 = 9.9652e-04
Validation auc = 0.699155
Epoch 5218
Loss = 4.2843e-02, PNorm = 389.8770, GNorm = 0.1648, lr_0 = 9.9651e-04
Validation auc = 0.695369
Epoch 5219
Loss = 1.7710e-02, PNorm = 389.9056, GNorm = 0.9167, lr_0 = 9.9651e-04
Loss = 1.1113e-02, PNorm = 389.9353, GNorm = 0.0969, lr_0 = 9.9651e-04
Validation auc = 0.693505
Epoch 5220
Loss = 7.1329e-03, PNorm = 389.9562, GNorm = 1.0156, lr_0 = 9.9651e-04
Validation auc = 0.693562
Epoch 5221
Loss = 1.2356e-02, PNorm = 389.9696, GNorm = 0.0607, lr_0 = 9.9651e-04
Validation auc = 0.696509
Epoch 5222
Loss = 1.5841e-02, PNorm = 389.9874, GNorm = 0.0510, lr_0 = 9.9651e-04
Validation auc = 0.699608
Epoch 5223
Loss = 2.1975e-02, PNorm = 390.0157, GNorm = 1.9594, lr_0 = 9.9651e-04
Validation auc = 0.694722
Epoch 5224
Loss = 4.9374e-02, PNorm = 390.0564, GNorm = 0.1638, lr_0 = 9.9651e-04
Validation auc = 0.695423
Epoch 5225
Loss = 1.6007e-02, PNorm = 390.1007, GNorm = 0.9776, lr_0 = 9.9651e-04
Validation auc = 0.689932
Epoch 5226
Loss = 1.1018e-02, PNorm = 390.1382, GNorm = 0.4407, lr_0 = 9.9651e-04
Validation auc = 0.683609
Epoch 5227
Loss = 5.3087e-03, PNorm = 390.1669, GNorm = 0.4549, lr_0 = 9.9651e-04
Validation auc = 0.674758
Epoch 5228
Loss = 7.0322e-02, PNorm = 390.1950, GNorm = 0.0115, lr_0 = 9.9651e-04
Validation auc = 0.660522
Epoch 5229
Loss = 3.5248e-03, PNorm = 390.2252, GNorm = 0.1365, lr_0 = 9.9651e-04
Loss = 1.1537e-02, PNorm = 390.2563, GNorm = 0.1429, lr_0 = 9.9651e-04
Validation auc = 0.657636
Epoch 5230
Loss = 8.7132e-03, PNorm = 390.2800, GNorm = 0.1329, lr_0 = 9.9651e-04
Validation auc = 0.657072
Epoch 5231
Loss = 5.6975e-02, PNorm = 390.3077, GNorm = 6.9546, lr_0 = 9.9650e-04
Validation auc = 0.647235
Epoch 5232
Loss = 3.8265e-02, PNorm = 390.3881, GNorm = 0.2467, lr_0 = 9.9650e-04
Validation auc = 0.656451
Epoch 5233
Loss = 1.7270e-02, PNorm = 390.4687, GNorm = 0.1478, lr_0 = 9.9650e-04
Validation auc = 0.664881
Epoch 5234
Loss = 3.0315e-02, PNorm = 390.5273, GNorm = 0.3989, lr_0 = 9.9650e-04
Validation auc = 0.660447
Epoch 5235
Loss = 1.0260e-02, PNorm = 390.5901, GNorm = 0.1934, lr_0 = 9.9650e-04
Validation auc = 0.656952
Epoch 5236
Loss = 3.9188e-02, PNorm = 390.6486, GNorm = 1.4800, lr_0 = 9.9650e-04
Validation auc = 0.658657
Epoch 5237
Loss = 1.4872e-02, PNorm = 390.6921, GNorm = 0.1061, lr_0 = 9.9650e-04
Validation auc = 0.667474
Epoch 5238
Loss = 1.0550e-02, PNorm = 390.7266, GNorm = 0.4968, lr_0 = 9.9650e-04
Validation auc = 0.672157
Epoch 5239
Loss = 2.0838e-03, PNorm = 390.7508, GNorm = 0.0623, lr_0 = 9.9650e-04
Loss = 3.6696e-02, PNorm = 390.7733, GNorm = 0.3866, lr_0 = 9.9650e-04
Validation auc = 0.676883
Epoch 5240
Loss = 1.0615e-02, PNorm = 390.7996, GNorm = 0.9475, lr_0 = 9.9650e-04
Validation auc = 0.683673
Epoch 5241
Loss = 5.4493e-03, PNorm = 390.8227, GNorm = 0.0455, lr_0 = 9.9650e-04
Validation auc = 0.682426
Epoch 5242
Loss = 3.1622e-03, PNorm = 390.8470, GNorm = 0.0367, lr_0 = 9.9650e-04
Validation auc = 0.682577
Epoch 5243
Loss = 2.0676e-02, PNorm = 390.8695, GNorm = 0.7347, lr_0 = 9.9650e-04
Validation auc = 0.677141
Epoch 5244
Loss = 8.2261e-03, PNorm = 390.8903, GNorm = 0.3118, lr_0 = 9.9649e-04
Validation auc = 0.671990
Epoch 5245
Loss = 2.0505e-02, PNorm = 390.9120, GNorm = 0.0252, lr_0 = 9.9649e-04
Validation auc = 0.668376
Epoch 5246
Loss = 3.8033e-02, PNorm = 390.9375, GNorm = 0.8186, lr_0 = 9.9649e-04
Validation auc = 0.663821
Epoch 5247
Loss = 5.3888e-02, PNorm = 390.9674, GNorm = 1.6317, lr_0 = 9.9649e-04
Validation auc = 0.665379
Epoch 5248
Loss = 1.9523e-02, PNorm = 391.0076, GNorm = 1.8935, lr_0 = 9.9649e-04
Validation auc = 0.667591
Epoch 5249
Loss = 1.0483e-02, PNorm = 391.0407, GNorm = 0.5794, lr_0 = 9.9649e-04
Loss = 2.2012e-02, PNorm = 391.0705, GNorm = 0.1583, lr_0 = 9.9649e-04
Validation auc = 0.665608
Epoch 5250
Loss = 2.0713e-02, PNorm = 391.1043, GNorm = 0.2384, lr_0 = 9.9649e-04
Validation auc = 0.665848
Epoch 5251
Loss = 3.0652e-02, PNorm = 391.1329, GNorm = 0.0969, lr_0 = 9.9649e-04
Validation auc = 0.677197
Epoch 5252
Loss = 7.2779e-03, PNorm = 391.1623, GNorm = 0.1029, lr_0 = 9.9649e-04
Validation auc = 0.683969
Epoch 5253
Loss = 5.0411e-03, PNorm = 391.1894, GNorm = 0.9832, lr_0 = 9.9649e-04
Validation auc = 0.685035
Epoch 5254
Loss = 1.2740e-02, PNorm = 391.2119, GNorm = 2.5429, lr_0 = 9.9649e-04
Validation auc = 0.683853
Epoch 5255
Loss = 1.8758e-02, PNorm = 391.2353, GNorm = 0.1296, lr_0 = 9.9649e-04
Validation auc = 0.681983
Epoch 5256
Loss = 6.5945e-02, PNorm = 391.2596, GNorm = 4.2175, lr_0 = 9.9649e-04
Validation auc = 0.680947
Epoch 5257
Loss = 3.6318e-02, PNorm = 391.3111, GNorm = 0.2691, lr_0 = 9.9649e-04
Validation auc = 0.678353
Epoch 5258
Loss = 8.3483e-02, PNorm = 391.3558, GNorm = 0.9466, lr_0 = 9.9648e-04
Validation auc = 0.673642
Epoch 5259
Loss = 4.8958e-02, PNorm = 391.3941, GNorm = 1.3786, lr_0 = 9.9648e-04
Loss = 3.8208e-02, PNorm = 391.4298, GNorm = 0.2155, lr_0 = 9.9648e-04
Validation auc = 0.674080
Epoch 5260
Loss = 1.5164e-02, PNorm = 391.4648, GNorm = 0.1653, lr_0 = 9.9648e-04
Validation auc = 0.674540
Epoch 5261
Loss = 3.7908e-02, PNorm = 391.4998, GNorm = 0.9474, lr_0 = 9.9648e-04
Validation auc = 0.674893
Epoch 5262
Loss = 2.6796e-02, PNorm = 391.5451, GNorm = 0.3333, lr_0 = 9.9648e-04
Validation auc = 0.673751
Epoch 5263
Loss = 2.8061e-02, PNorm = 391.5980, GNorm = 0.6277, lr_0 = 9.9648e-04
Validation auc = 0.671127
Epoch 5264
Loss = 3.9769e-02, PNorm = 391.6394, GNorm = 0.1028, lr_0 = 9.9648e-04
Validation auc = 0.674775
Epoch 5265
Loss = 2.3208e-02, PNorm = 391.6741, GNorm = 0.4942, lr_0 = 9.9648e-04
Validation auc = 0.680744
Epoch 5266
Loss = 2.9606e-02, PNorm = 391.7045, GNorm = 0.8927, lr_0 = 9.9648e-04
Validation auc = 0.674154
Epoch 5267
Loss = 4.5277e-03, PNorm = 391.7338, GNorm = 0.1160, lr_0 = 9.9648e-04
Validation auc = 0.664927
Epoch 5268
Loss = 1.1251e-02, PNorm = 391.7645, GNorm = 0.2502, lr_0 = 9.9648e-04
Validation auc = 0.662454
Epoch 5269
Loss = 1.4925e-01, PNorm = 391.7903, GNorm = 2.4059, lr_0 = 9.9648e-04
Loss = 8.0315e-03, PNorm = 391.8223, GNorm = 0.9570, lr_0 = 9.9648e-04
Validation auc = 0.665725
Epoch 5270
Loss = 1.0492e-02, PNorm = 391.8488, GNorm = 0.1833, lr_0 = 9.9647e-04
Validation auc = 0.674454
Epoch 5271
Loss = 5.7644e-02, PNorm = 391.8779, GNorm = 0.2475, lr_0 = 9.9647e-04
Validation auc = 0.677611
Epoch 5272
Loss = 2.6090e-02, PNorm = 391.9174, GNorm = 0.3324, lr_0 = 9.9647e-04
Validation auc = 0.674268
Epoch 5273
Loss = 5.0330e-02, PNorm = 391.9628, GNorm = 1.1319, lr_0 = 9.9647e-04
Validation auc = 0.684946
Epoch 5274
Loss = 6.3340e-02, PNorm = 392.0200, GNorm = 0.2209, lr_0 = 9.9647e-04
Validation auc = 0.684160
Epoch 5275
Loss = 2.1739e-02, PNorm = 392.0784, GNorm = 0.8209, lr_0 = 9.9647e-04
Validation auc = 0.676989
Epoch 5276
Loss = 2.9945e-02, PNorm = 392.1277, GNorm = 1.4429, lr_0 = 9.9647e-04
Validation auc = 0.674855
Epoch 5277
Loss = 8.1389e-02, PNorm = 392.1649, GNorm = 1.5643, lr_0 = 9.9647e-04
Validation auc = 0.673979
Epoch 5278
Loss = 4.7286e-02, PNorm = 392.2089, GNorm = 3.5748, lr_0 = 9.9647e-04
Validation auc = 0.672745
Epoch 5279
Loss = 2.4818e-02, PNorm = 392.2562, GNorm = 1.2831, lr_0 = 9.9647e-04
Loss = 5.6291e-02, PNorm = 392.3047, GNorm = 1.1586, lr_0 = 9.9647e-04
Validation auc = 0.668869
Epoch 5280
Loss = 1.7424e-02, PNorm = 392.3613, GNorm = 0.1522, lr_0 = 9.9647e-04
Validation auc = 0.668057
Epoch 5281
Loss = 2.7385e-02, PNorm = 392.4015, GNorm = 0.3134, lr_0 = 9.9647e-04
Validation auc = 0.668012
Epoch 5282
Loss = 4.9379e-02, PNorm = 392.4478, GNorm = 1.2993, lr_0 = 9.9647e-04
Validation auc = 0.671323
Epoch 5283
Loss = 1.0082e-01, PNorm = 392.5059, GNorm = 2.1289, lr_0 = 9.9647e-04
Validation auc = 0.679233
Epoch 5284
Loss = 2.9779e-02, PNorm = 392.5776, GNorm = 2.9721, lr_0 = 9.9646e-04
Validation auc = 0.690640
Epoch 5285
Loss = 3.9233e-02, PNorm = 392.6455, GNorm = 1.9547, lr_0 = 9.9646e-04
Validation auc = 0.698622
Epoch 5286
Loss = 6.2242e-02, PNorm = 392.7064, GNorm = 1.6111, lr_0 = 9.9646e-04
Validation auc = 0.694381
Epoch 5287
Loss = 3.6350e-02, PNorm = 392.7575, GNorm = 1.2271, lr_0 = 9.9646e-04
Validation auc = 0.695457
Epoch 5288
Loss = 1.5340e-02, PNorm = 392.8028, GNorm = 1.0173, lr_0 = 9.9646e-04
Validation auc = 0.695511
Epoch 5289
Loss = 4.5731e-04, PNorm = 392.8350, GNorm = 0.0351, lr_0 = 9.9646e-04
Loss = 3.7720e-02, PNorm = 392.8620, GNorm = 0.0451, lr_0 = 9.9646e-04
Validation auc = 0.692722
Epoch 5290
Loss = 1.5358e-02, PNorm = 392.8956, GNorm = 0.1944, lr_0 = 9.9646e-04
Validation auc = 0.695741
Epoch 5291
Loss = 4.1619e-02, PNorm = 392.9339, GNorm = 0.0256, lr_0 = 9.9646e-04
Validation auc = 0.703271
Epoch 5292
Loss = 7.4166e-02, PNorm = 392.9674, GNorm = 5.1388, lr_0 = 9.9646e-04
Validation auc = 0.694404
Epoch 5293
Loss = 2.1121e-02, PNorm = 393.0074, GNorm = 0.3515, lr_0 = 9.9646e-04
Validation auc = 0.685538
Epoch 5294
Loss = 2.1945e-02, PNorm = 393.0476, GNorm = 0.9256, lr_0 = 9.9646e-04
Validation auc = 0.681901
Epoch 5295
Loss = 8.9619e-02, PNorm = 393.1061, GNorm = 0.0399, lr_0 = 9.9646e-04
Validation auc = 0.679068
Epoch 5296
Loss = 1.9591e-02, PNorm = 393.1571, GNorm = 1.7249, lr_0 = 9.9646e-04
Validation auc = 0.681404
Epoch 5297
Loss = 1.6215e-02, PNorm = 393.1958, GNorm = 0.1880, lr_0 = 9.9645e-04
Validation auc = 0.675860
Epoch 5298
Loss = 1.7851e-02, PNorm = 393.2391, GNorm = 0.8490, lr_0 = 9.9645e-04
Validation auc = 0.677701
Epoch 5299
Loss = 2.4680e-02, PNorm = 393.2769, GNorm = 0.8947, lr_0 = 9.9645e-04
Loss = 1.0571e-02, PNorm = 393.3089, GNorm = 0.1222, lr_0 = 9.9645e-04
Validation auc = 0.677487
Epoch 5300
Loss = 7.4558e-02, PNorm = 393.3420, GNorm = 0.0212, lr_0 = 9.9645e-04
Validation auc = 0.678680
Epoch 5301
Loss = 4.5982e-02, PNorm = 393.3835, GNorm = 0.1117, lr_0 = 9.9645e-04
Validation auc = 0.674147
Epoch 5302
Loss = 2.8246e-02, PNorm = 393.4216, GNorm = 0.4911, lr_0 = 9.9645e-04
Validation auc = 0.670962
Epoch 5303
Loss = 1.3480e-02, PNorm = 393.4565, GNorm = 0.1592, lr_0 = 9.9645e-04
Validation auc = 0.670770
Epoch 5304
Loss = 3.2644e-02, PNorm = 393.4857, GNorm = 0.1619, lr_0 = 9.9645e-04
Validation auc = 0.673696
Epoch 5305
Loss = 4.0490e-02, PNorm = 393.5174, GNorm = 3.9966, lr_0 = 9.9645e-04
Validation auc = 0.675366
Epoch 5306
Loss = 3.4766e-02, PNorm = 393.5694, GNorm = 1.1781, lr_0 = 9.9645e-04
Validation auc = 0.680412
Epoch 5307
Loss = 1.2975e-02, PNorm = 393.6146, GNorm = 0.1628, lr_0 = 9.9645e-04
Validation auc = 0.687820
Epoch 5308
Loss = 2.1489e-03, PNorm = 393.6592, GNorm = 0.2042, lr_0 = 9.9645e-04
Validation auc = 0.687386
Epoch 5309
Loss = 2.3256e-03, PNorm = 393.6942, GNorm = 0.0808, lr_0 = 9.9645e-04
Loss = 2.6987e-02, PNorm = 393.7230, GNorm = 2.3560, lr_0 = 9.9645e-04
Validation auc = 0.678934
Epoch 5310
Loss = 4.7092e-02, PNorm = 393.7487, GNorm = 1.2376, lr_0 = 9.9644e-04
Validation auc = 0.666953
Epoch 5311
Loss = 2.9429e-02, PNorm = 393.7806, GNorm = 0.4732, lr_0 = 9.9644e-04
Validation auc = 0.672472
Epoch 5312
Loss = 4.1211e-02, PNorm = 393.8160, GNorm = 1.7673, lr_0 = 9.9644e-04
Validation auc = 0.672749
Epoch 5313
Loss = 3.3507e-02, PNorm = 393.8478, GNorm = 0.1107, lr_0 = 9.9644e-04
Validation auc = 0.669790
Epoch 5314
Loss = 2.1953e-02, PNorm = 393.8746, GNorm = 0.8487, lr_0 = 9.9644e-04
Validation auc = 0.664278
Epoch 5315
Loss = 6.1902e-02, PNorm = 393.8929, GNorm = 0.0443, lr_0 = 9.9644e-04
Validation auc = 0.675032
Epoch 5316
Loss = 3.3148e-02, PNorm = 393.9122, GNorm = 0.4369, lr_0 = 9.9644e-04
Validation auc = 0.678137
Epoch 5317
Loss = 1.2605e-03, PNorm = 393.9398, GNorm = 0.0785, lr_0 = 9.9644e-04
Validation auc = 0.678365
Epoch 5318
Loss = 6.8732e-03, PNorm = 393.9601, GNorm = 0.8142, lr_0 = 9.9644e-04
Validation auc = 0.677525
Epoch 5319
Loss = 2.6096e-03, PNorm = 393.9824, GNorm = 0.1001, lr_0 = 9.9644e-04
Loss = 3.2354e-02, PNorm = 394.0038, GNorm = 0.5111, lr_0 = 9.9644e-04
Validation auc = 0.681717
Epoch 5320
Loss = 4.3331e-02, PNorm = 394.0366, GNorm = 0.1462, lr_0 = 9.9644e-04
Validation auc = 0.668678
Epoch 5321
Loss = 5.5748e-02, PNorm = 394.0718, GNorm = 0.1764, lr_0 = 9.9644e-04
Validation auc = 0.666744
Epoch 5322
Loss = 1.7722e-02, PNorm = 394.1064, GNorm = 0.2501, lr_0 = 9.9644e-04
Validation auc = 0.669234
Epoch 5323
Loss = 4.2318e-02, PNorm = 394.1391, GNorm = 0.3260, lr_0 = 9.9644e-04
Validation auc = 0.678092
Epoch 5324
Loss = 1.6178e-02, PNorm = 394.1705, GNorm = 0.2641, lr_0 = 9.9643e-04
Validation auc = 0.675616
Epoch 5325
Loss = 4.4907e-02, PNorm = 394.1929, GNorm = 0.4338, lr_0 = 9.9643e-04
Validation auc = 0.670527
Epoch 5326
Loss = 2.3337e-02, PNorm = 394.2091, GNorm = 1.9030, lr_0 = 9.9643e-04
Validation auc = 0.665094
Epoch 5327
Loss = 2.8827e-02, PNorm = 394.2253, GNorm = 0.8311, lr_0 = 9.9643e-04
Validation auc = 0.673767
Epoch 5328
Loss = 1.6339e-03, PNorm = 394.2659, GNorm = 0.0226, lr_0 = 9.9643e-04
Validation auc = 0.677887
Epoch 5329
Loss = 1.4584e-03, PNorm = 394.3029, GNorm = 0.0630, lr_0 = 9.9643e-04
Loss = 4.7232e-02, PNorm = 394.3320, GNorm = 1.9931, lr_0 = 9.9643e-04
Validation auc = 0.674694
Epoch 5330
Loss = 2.8436e-02, PNorm = 394.3713, GNorm = 1.3051, lr_0 = 9.9643e-04
Validation auc = 0.680708
Epoch 5331
Loss = 3.3967e-02, PNorm = 394.4082, GNorm = 0.1232, lr_0 = 9.9643e-04
Validation auc = 0.685835
Epoch 5332
Loss = 6.7592e-02, PNorm = 394.4402, GNorm = 1.0683, lr_0 = 9.9643e-04
Validation auc = 0.686586
Epoch 5333
Loss = 2.3601e-02, PNorm = 394.4707, GNorm = 1.0340, lr_0 = 9.9643e-04
Validation auc = 0.686915
Epoch 5334
Loss = 4.3504e-02, PNorm = 394.5007, GNorm = 3.2529, lr_0 = 9.9643e-04
Validation auc = 0.688981
Epoch 5335
Loss = 2.5517e-02, PNorm = 394.5305, GNorm = 1.6561, lr_0 = 9.9643e-04
Validation auc = 0.695991
Epoch 5336
Loss = 2.0677e-02, PNorm = 394.5550, GNorm = 1.5860, lr_0 = 9.9643e-04
Validation auc = 0.702053
Epoch 5337
Loss = 1.7466e-02, PNorm = 394.5893, GNorm = 0.1960, lr_0 = 9.9642e-04
Validation auc = 0.707388
Epoch 5338
Loss = 1.7340e-02, PNorm = 394.6214, GNorm = 1.0567, lr_0 = 9.9642e-04
Validation auc = 0.701659
Epoch 5339
Loss = 9.4313e-02, PNorm = 394.6568, GNorm = 1.6359, lr_0 = 9.9642e-04
Loss = 3.2343e-02, PNorm = 394.6996, GNorm = 2.7608, lr_0 = 9.9642e-04
Validation auc = 0.698936
Epoch 5340
Loss = 2.8617e-02, PNorm = 394.7544, GNorm = 1.9433, lr_0 = 9.9642e-04
Validation auc = 0.701513
Epoch 5341
Loss = 9.5925e-03, PNorm = 394.7948, GNorm = 1.3823, lr_0 = 9.9642e-04
Validation auc = 0.704457
Epoch 5342
Loss = 8.1619e-02, PNorm = 394.8271, GNorm = 0.2575, lr_0 = 9.9642e-04
Validation auc = 0.709012
Epoch 5343
Loss = 1.1171e-02, PNorm = 394.8730, GNorm = 0.4055, lr_0 = 9.9642e-04
Validation auc = 0.710109
Epoch 5344
Loss = 3.0519e-02, PNorm = 394.9064, GNorm = 0.6052, lr_0 = 9.9642e-04
Validation auc = 0.701660
Epoch 5345
Loss = 2.4341e-02, PNorm = 394.9398, GNorm = 0.2127, lr_0 = 9.9642e-04
Validation auc = 0.697029
Epoch 5346
Loss = 2.7119e-02, PNorm = 394.9680, GNorm = 0.8041, lr_0 = 9.9642e-04
Validation auc = 0.691343
Epoch 5347
Loss = 2.6663e-02, PNorm = 394.9927, GNorm = 1.2292, lr_0 = 9.9642e-04
Validation auc = 0.699528
Epoch 5348
Loss = 9.9988e-03, PNorm = 395.0295, GNorm = 0.5072, lr_0 = 9.9642e-04
Validation auc = 0.695596
Epoch 5349
Loss = 6.8269e-02, PNorm = 395.0651, GNorm = 1.9296, lr_0 = 9.9642e-04
Loss = 1.8288e-02, PNorm = 395.0903, GNorm = 0.5209, lr_0 = 9.9642e-04
Validation auc = 0.685579
Epoch 5350
Loss = 1.6687e-02, PNorm = 395.1086, GNorm = 1.5047, lr_0 = 9.9641e-04
Validation auc = 0.681298
Epoch 5351
Loss = 2.3865e-02, PNorm = 395.1324, GNorm = 3.3034, lr_0 = 9.9641e-04
Validation auc = 0.676112
Epoch 5352
Loss = 1.7024e-02, PNorm = 395.1606, GNorm = 0.7853, lr_0 = 9.9641e-04
Validation auc = 0.673182
Epoch 5353
Loss = 7.7538e-03, PNorm = 395.1873, GNorm = 0.0454, lr_0 = 9.9641e-04
Validation auc = 0.671476
Epoch 5354
Loss = 5.9694e-03, PNorm = 395.2061, GNorm = 0.1292, lr_0 = 9.9641e-04
Validation auc = 0.670821
Epoch 5355
Loss = 1.4154e-02, PNorm = 395.2225, GNorm = 2.0870, lr_0 = 9.9641e-04
Validation auc = 0.675177
Epoch 5356
Loss = 5.4328e-02, PNorm = 395.2538, GNorm = 0.0117, lr_0 = 9.9641e-04
Validation auc = 0.667771
Epoch 5357
Loss = 1.0962e-03, PNorm = 395.3027, GNorm = 0.0807, lr_0 = 9.9641e-04
Validation auc = 0.661791
Epoch 5358
Loss = 2.8059e-02, PNorm = 395.3490, GNorm = 1.5628, lr_0 = 9.9641e-04
Validation auc = 0.659441
Epoch 5359
Loss = 4.7920e-02, PNorm = 395.4007, GNorm = 1.1283, lr_0 = 9.9641e-04
Loss = 4.7175e-02, PNorm = 395.4493, GNorm = 4.6853, lr_0 = 9.9641e-04
Validation auc = 0.652801
Epoch 5360
Loss = 6.1555e-02, PNorm = 395.5034, GNorm = 1.2825, lr_0 = 9.9641e-04
Validation auc = 0.648430
Epoch 5361
Loss = 3.6461e-02, PNorm = 395.5548, GNorm = 0.6491, lr_0 = 9.9641e-04
Validation auc = 0.645088
Epoch 5362
Loss = 9.3795e-03, PNorm = 395.6014, GNorm = 0.1316, lr_0 = 9.9641e-04
Validation auc = 0.648711
Epoch 5363
Loss = 3.1804e-02, PNorm = 395.6324, GNorm = 0.2443, lr_0 = 9.9640e-04
Validation auc = 0.652893
Epoch 5364
Loss = 4.3823e-02, PNorm = 395.6596, GNorm = 0.0792, lr_0 = 9.9640e-04
Validation auc = 0.654829
Epoch 5365
Loss = 4.7161e-03, PNorm = 395.6851, GNorm = 0.5389, lr_0 = 9.9640e-04
Validation auc = 0.656588
Epoch 5366
Loss = 5.1186e-03, PNorm = 395.7088, GNorm = 0.1833, lr_0 = 9.9640e-04
Validation auc = 0.659472
Epoch 5367
Loss = 1.2791e-02, PNorm = 395.7337, GNorm = 0.1860, lr_0 = 9.9640e-04
Validation auc = 0.655962
Epoch 5368
Loss = 1.4325e-02, PNorm = 395.7683, GNorm = 0.9168, lr_0 = 9.9640e-04
Validation auc = 0.656437
Epoch 5369
Loss = 2.9524e-03, PNorm = 395.8066, GNorm = 0.1331, lr_0 = 9.9640e-04
Loss = 2.6025e-02, PNorm = 395.8354, GNorm = 0.2274, lr_0 = 9.9640e-04
Validation auc = 0.650652
Epoch 5370
Loss = 7.4064e-03, PNorm = 395.8650, GNorm = 0.2769, lr_0 = 9.9640e-04
Validation auc = 0.650845
Epoch 5371
Loss = 6.3305e-02, PNorm = 395.9000, GNorm = 0.0340, lr_0 = 9.9640e-04
Validation auc = 0.659920
Epoch 5372
Loss = 2.9111e-02, PNorm = 395.9519, GNorm = 1.1404, lr_0 = 9.9640e-04
Validation auc = 0.667572
Epoch 5373
Loss = 1.0189e-02, PNorm = 395.9998, GNorm = 0.7651, lr_0 = 9.9640e-04
Validation auc = 0.668362
Epoch 5374
Loss = 2.9064e-02, PNorm = 396.0356, GNorm = 0.0928, lr_0 = 9.9640e-04
Validation auc = 0.664503
Epoch 5375
Loss = 1.2041e-02, PNorm = 396.0687, GNorm = 1.8551, lr_0 = 9.9640e-04
Validation auc = 0.664477
Epoch 5376
Loss = 2.3558e-02, PNorm = 396.0935, GNorm = 1.2541, lr_0 = 9.9640e-04
Validation auc = 0.665616
Epoch 5377
Loss = 4.3874e-02, PNorm = 396.1201, GNorm = 1.0906, lr_0 = 9.9639e-04
Validation auc = 0.660080
Epoch 5378
Loss = 2.9004e-03, PNorm = 396.1575, GNorm = 0.0932, lr_0 = 9.9639e-04
Validation auc = 0.654537
Epoch 5379
Loss = 5.3573e-02, PNorm = 396.1874, GNorm = 2.5324, lr_0 = 9.9639e-04
Loss = 2.9253e-02, PNorm = 396.2117, GNorm = 0.2888, lr_0 = 9.9639e-04
Validation auc = 0.650815
Epoch 5380
Loss = 3.3930e-02, PNorm = 396.2377, GNorm = 1.1463, lr_0 = 9.9639e-04
Validation auc = 0.651723
Epoch 5381
Loss = 2.7319e-02, PNorm = 396.2648, GNorm = 0.5580, lr_0 = 9.9639e-04
Validation auc = 0.660879
Epoch 5382
Loss = 6.9866e-02, PNorm = 396.3001, GNorm = 2.1529, lr_0 = 9.9639e-04
Validation auc = 0.667287
Epoch 5383
Loss = 3.4614e-02, PNorm = 396.3428, GNorm = 3.4176, lr_0 = 9.9639e-04
Validation auc = 0.670628
Epoch 5384
Loss = 3.5225e-02, PNorm = 396.3845, GNorm = 1.6072, lr_0 = 9.9639e-04
Validation auc = 0.665385
Epoch 5385
Loss = 4.9214e-02, PNorm = 396.4186, GNorm = 0.1439, lr_0 = 9.9639e-04
Validation auc = 0.661866
Epoch 5386
Loss = 5.8842e-03, PNorm = 396.4461, GNorm = 0.3703, lr_0 = 9.9639e-04
Validation auc = 0.663183
Epoch 5387
Loss = 2.8039e-02, PNorm = 396.4676, GNorm = 0.9551, lr_0 = 9.9639e-04
Validation auc = 0.665681
Epoch 5388
Loss = 3.3632e-03, PNorm = 396.4921, GNorm = 0.1475, lr_0 = 9.9639e-04
Validation auc = 0.665501
Epoch 5389
Loss = 7.8817e-04, PNorm = 396.5127, GNorm = 0.0363, lr_0 = 9.9639e-04
Loss = 2.2558e-02, PNorm = 396.5309, GNorm = 1.1856, lr_0 = 9.9638e-04
Validation auc = 0.664771
Epoch 5390
Loss = 2.2034e-02, PNorm = 396.5558, GNorm = 2.6835, lr_0 = 9.9638e-04
Validation auc = 0.670150
Epoch 5391
Loss = 8.4628e-03, PNorm = 396.5952, GNorm = 0.4234, lr_0 = 9.9638e-04
Validation auc = 0.676621
Epoch 5392
Loss = 1.8690e-02, PNorm = 396.6357, GNorm = 0.4489, lr_0 = 9.9638e-04
Validation auc = 0.681054
Epoch 5393
Loss = 5.0988e-02, PNorm = 396.6649, GNorm = 2.4881, lr_0 = 9.9638e-04
Validation auc = 0.679518
Epoch 5394
Loss = 9.3385e-03, PNorm = 396.6952, GNorm = 0.1882, lr_0 = 9.9638e-04
Validation auc = 0.680110
Epoch 5395
Loss = 3.2475e-02, PNorm = 396.7291, GNorm = 0.3593, lr_0 = 9.9638e-04
Validation auc = 0.690086
Epoch 5396
Loss = 5.5945e-02, PNorm = 396.7623, GNorm = 0.4270, lr_0 = 9.9638e-04
Validation auc = 0.693386
Epoch 5397
Loss = 4.9795e-02, PNorm = 396.7873, GNorm = 0.2129, lr_0 = 9.9638e-04
Validation auc = 0.695688
Epoch 5398
Loss = 2.5340e-02, PNorm = 396.8174, GNorm = 0.9169, lr_0 = 9.9638e-04
Validation auc = 0.696684
Epoch 5399
Loss = 3.2288e-03, PNorm = 396.8537, GNorm = 0.1334, lr_0 = 9.9638e-04
Loss = 3.3588e-02, PNorm = 396.8840, GNorm = 1.1116, lr_0 = 9.9638e-04
Validation auc = 0.696228
Epoch 5400
Loss = 7.8454e-03, PNorm = 396.9077, GNorm = 0.3991, lr_0 = 9.9638e-04
Validation auc = 0.686240
Epoch 5401
Loss = 2.4611e-02, PNorm = 396.9341, GNorm = 1.8064, lr_0 = 9.9638e-04
Validation auc = 0.678272
Epoch 5402
Loss = 2.4879e-02, PNorm = 396.9630, GNorm = 3.4124, lr_0 = 9.9638e-04
Validation auc = 0.666986
Epoch 5403
Loss = 5.8485e-02, PNorm = 397.0000, GNorm = 0.3151, lr_0 = 9.9637e-04
Validation auc = 0.655916
Epoch 5404
Loss = 2.1136e-02, PNorm = 397.0357, GNorm = 1.2806, lr_0 = 9.9637e-04
Validation auc = 0.648887
Epoch 5405
Loss = 3.6585e-03, PNorm = 397.0686, GNorm = 0.1607, lr_0 = 9.9637e-04
Validation auc = 0.652800
Epoch 5406
Loss = 1.0296e-02, PNorm = 397.1154, GNorm = 0.0909, lr_0 = 9.9637e-04
Validation auc = 0.662652
Epoch 5407
Loss = 8.7616e-03, PNorm = 397.1549, GNorm = 0.2407, lr_0 = 9.9637e-04
Validation auc = 0.659699
Epoch 5408
Loss = 6.1411e-03, PNorm = 397.1804, GNorm = 0.2655, lr_0 = 9.9637e-04
Validation auc = 0.658768
Epoch 5409
Loss = 2.7423e-03, PNorm = 397.2000, GNorm = 0.3486, lr_0 = 9.9637e-04
Loss = 3.5302e-02, PNorm = 397.2190, GNorm = 0.2063, lr_0 = 9.9637e-04
Validation auc = 0.655390
Epoch 5410
Loss = 1.6875e-02, PNorm = 397.2390, GNorm = 5.1164, lr_0 = 9.9637e-04
Validation auc = 0.650203
Epoch 5411
Loss = 3.1748e-02, PNorm = 397.2651, GNorm = 0.0491, lr_0 = 9.9637e-04
Validation auc = 0.645599
Epoch 5412
Loss = 1.4714e-02, PNorm = 397.2868, GNorm = 0.1366, lr_0 = 9.9637e-04
Validation auc = 0.641511
Epoch 5413
Loss = 3.4133e-02, PNorm = 397.3056, GNorm = 0.5739, lr_0 = 9.9637e-04
Validation auc = 0.639449
Epoch 5414
Loss = 4.4845e-02, PNorm = 397.3329, GNorm = 3.2468, lr_0 = 9.9637e-04
Validation auc = 0.653778
Epoch 5415
Loss = 4.1989e-02, PNorm = 397.3788, GNorm = 0.7975, lr_0 = 9.9637e-04
Validation auc = 0.660782
Epoch 5416
Loss = 1.7247e-02, PNorm = 397.4215, GNorm = 0.8055, lr_0 = 9.9637e-04
Validation auc = 0.662874
Epoch 5417
Loss = 1.0002e-02, PNorm = 397.4528, GNorm = 0.8019, lr_0 = 9.9636e-04
Validation auc = 0.659282
Epoch 5418
Loss = 6.4889e-03, PNorm = 397.4807, GNorm = 0.1266, lr_0 = 9.9636e-04
Validation auc = 0.656986
Epoch 5419
Loss = 3.7215e-03, PNorm = 397.5086, GNorm = 0.2029, lr_0 = 9.9636e-04
Loss = 7.3140e-03, PNorm = 397.5384, GNorm = 0.1229, lr_0 = 9.9636e-04
Validation auc = 0.656583
Epoch 5420
Loss = 3.1134e-02, PNorm = 397.5730, GNorm = 0.7891, lr_0 = 9.9636e-04
Validation auc = 0.653049
Epoch 5421
Loss = 6.8474e-02, PNorm = 397.6089, GNorm = 0.0415, lr_0 = 9.9636e-04
Validation auc = 0.651504
Epoch 5422
Loss = 4.1994e-02, PNorm = 397.6425, GNorm = 2.7460, lr_0 = 9.9636e-04
Validation auc = 0.653424
Epoch 5423
Loss = 1.1353e-02, PNorm = 397.6770, GNorm = 0.4927, lr_0 = 9.9636e-04
Validation auc = 0.658998
Epoch 5424
Loss = 2.1551e-02, PNorm = 397.7027, GNorm = 0.7892, lr_0 = 9.9636e-04
Validation auc = 0.655530
Epoch 5425
Loss = 1.9717e-02, PNorm = 397.7261, GNorm = 1.8962, lr_0 = 9.9636e-04
Validation auc = 0.649513
Epoch 5426
Loss = 1.0996e-02, PNorm = 397.7513, GNorm = 1.4959, lr_0 = 9.9636e-04
Validation auc = 0.646440
Epoch 5427
Loss = 4.2094e-02, PNorm = 397.7716, GNorm = 1.2462, lr_0 = 9.9636e-04
Validation auc = 0.645112
Epoch 5428
Loss = 3.8337e-03, PNorm = 397.7968, GNorm = 0.2304, lr_0 = 9.9636e-04
Validation auc = 0.646219
Epoch 5429
Loss = 1.0970e-02, PNorm = 397.8199, GNorm = 0.8400, lr_0 = 9.9636e-04
Loss = 5.9840e-03, PNorm = 397.8409, GNorm = 0.1041, lr_0 = 9.9635e-04
Validation auc = 0.649581
Epoch 5430
Loss = 6.3552e-02, PNorm = 397.8622, GNorm = 0.4661, lr_0 = 9.9635e-04
Validation auc = 0.662263
Epoch 5431
Loss = 2.3324e-02, PNorm = 397.9003, GNorm = 0.5810, lr_0 = 9.9635e-04
Validation auc = 0.681346
Epoch 5432
Loss = 3.7772e-02, PNorm = 397.9362, GNorm = 0.4647, lr_0 = 9.9635e-04
Validation auc = 0.680905
Epoch 5433
Loss = 4.4305e-02, PNorm = 397.9827, GNorm = 0.8812, lr_0 = 9.9635e-04
Validation auc = 0.678057
Epoch 5434
Loss = 2.2315e-02, PNorm = 398.0346, GNorm = 2.2099, lr_0 = 9.9635e-04
Validation auc = 0.666919
Epoch 5435
Loss = 2.0153e-02, PNorm = 398.0810, GNorm = 0.6921, lr_0 = 9.9635e-04
Validation auc = 0.662806
Epoch 5436
Loss = 6.4791e-02, PNorm = 398.1192, GNorm = 1.4305, lr_0 = 9.9635e-04
Validation auc = 0.668139
Epoch 5437
Loss = 6.6059e-02, PNorm = 398.1672, GNorm = 0.7937, lr_0 = 9.9635e-04
Validation auc = 0.668902
Epoch 5438
Loss = 4.4737e-02, PNorm = 398.2199, GNorm = 0.8851, lr_0 = 9.9635e-04
Validation auc = 0.666479
Epoch 5439
Loss = 1.3854e-02, PNorm = 398.2754, GNorm = 0.7619, lr_0 = 9.9635e-04
Loss = 1.8494e-02, PNorm = 398.3295, GNorm = 0.2103, lr_0 = 9.9635e-04
Validation auc = 0.665059
Epoch 5440
Loss = 3.5602e-02, PNorm = 398.3652, GNorm = 1.2297, lr_0 = 9.9635e-04
Validation auc = 0.661905
Epoch 5441
Loss = 2.0727e-02, PNorm = 398.3976, GNorm = 0.3028, lr_0 = 9.9635e-04
Validation auc = 0.669036
Epoch 5442
Loss = 3.5447e-02, PNorm = 398.4331, GNorm = 0.0646, lr_0 = 9.9635e-04
Validation auc = 0.673771
Epoch 5443
Loss = 5.4732e-02, PNorm = 398.4638, GNorm = 0.7384, lr_0 = 9.9634e-04
Validation auc = 0.668840
Epoch 5444
Loss = 1.4221e-02, PNorm = 398.5049, GNorm = 0.2905, lr_0 = 9.9634e-04
Validation auc = 0.668174
Epoch 5445
Loss = 2.2381e-02, PNorm = 398.5390, GNorm = 0.1355, lr_0 = 9.9634e-04
Validation auc = 0.668340
Epoch 5446
Loss = 5.9608e-03, PNorm = 398.5740, GNorm = 0.4205, lr_0 = 9.9634e-04
Validation auc = 0.671444
Epoch 5447
Loss = 1.3101e-02, PNorm = 398.6045, GNorm = 0.8742, lr_0 = 9.9634e-04
Validation auc = 0.669038
Epoch 5448
Loss = 2.6246e-02, PNorm = 398.6271, GNorm = 1.8892, lr_0 = 9.9634e-04
Validation auc = 0.673861
Epoch 5449
Loss = 1.4893e-02, PNorm = 398.6664, GNorm = 0.7377, lr_0 = 9.9634e-04
Loss = 2.1368e-02, PNorm = 398.7163, GNorm = 1.6300, lr_0 = 9.9634e-04
Validation auc = 0.677229
Epoch 5450
Loss = 8.8671e-03, PNorm = 398.7586, GNorm = 0.1323, lr_0 = 9.9634e-04
Validation auc = 0.678900
Epoch 5451
Loss = 6.0598e-02, PNorm = 398.7877, GNorm = 1.4281, lr_0 = 9.9634e-04
Validation auc = 0.688950
Epoch 5452
Loss = 3.5574e-02, PNorm = 398.8189, GNorm = 0.0590, lr_0 = 9.9634e-04
Validation auc = 0.692972
Epoch 5453
Loss = 3.1706e-02, PNorm = 398.8475, GNorm = 0.1789, lr_0 = 9.9634e-04
Validation auc = 0.694895
Epoch 5454
Loss = 4.2857e-02, PNorm = 398.8781, GNorm = 1.6869, lr_0 = 9.9634e-04
Validation auc = 0.681002
Epoch 5455
Loss = 2.2973e-02, PNorm = 398.9118, GNorm = 1.1668, lr_0 = 9.9634e-04
Validation auc = 0.685429
Epoch 5456
Loss = 3.1737e-02, PNorm = 398.9591, GNorm = 0.1064, lr_0 = 9.9633e-04
Validation auc = 0.678039
Epoch 5457
Loss = 7.3739e-02, PNorm = 399.0028, GNorm = 2.0291, lr_0 = 9.9633e-04
Validation auc = 0.677200
Epoch 5458
Loss = 7.5111e-03, PNorm = 399.0330, GNorm = 0.0921, lr_0 = 9.9633e-04
Validation auc = 0.678425
Epoch 5459
Loss = 3.6476e-03, PNorm = 399.0554, GNorm = 0.1339, lr_0 = 9.9633e-04
Loss = 1.9920e-02, PNorm = 399.0758, GNorm = 0.6719, lr_0 = 9.9633e-04
Validation auc = 0.682854
Epoch 5460
Loss = 1.0721e-02, PNorm = 399.0941, GNorm = 2.1759, lr_0 = 9.9633e-04
Validation auc = 0.686427
Epoch 5461
Loss = 6.6095e-02, PNorm = 399.1162, GNorm = 3.0085, lr_0 = 9.9633e-04
Validation auc = 0.674035
Epoch 5462
Loss = 1.0873e-02, PNorm = 399.1456, GNorm = 0.4335, lr_0 = 9.9633e-04
Validation auc = 0.669363
Epoch 5463
Loss = 3.0775e-02, PNorm = 399.1787, GNorm = 1.5442, lr_0 = 9.9633e-04
Validation auc = 0.673404
Epoch 5464
Loss = 8.2297e-03, PNorm = 399.2093, GNorm = 0.2187, lr_0 = 9.9633e-04
Validation auc = 0.683818
Epoch 5465
Loss = 5.4295e-02, PNorm = 399.2404, GNorm = 0.1157, lr_0 = 9.9633e-04
Validation auc = 0.684635
Epoch 5466
Loss = 1.5647e-02, PNorm = 399.2799, GNorm = 0.6585, lr_0 = 9.9633e-04
Validation auc = 0.697423
Epoch 5467
Loss = 2.2042e-02, PNorm = 399.3274, GNorm = 0.7904, lr_0 = 9.9633e-04
Validation auc = 0.701945
Epoch 5468
Loss = 4.9729e-02, PNorm = 399.3626, GNorm = 0.7492, lr_0 = 9.9633e-04
Validation auc = 0.705304
Epoch 5469
Loss = 4.2171e-03, PNorm = 399.3953, GNorm = 0.1473, lr_0 = 9.9633e-04
Loss = 2.1444e-02, PNorm = 399.4242, GNorm = 0.1017, lr_0 = 9.9632e-04
Validation auc = 0.705621
Epoch 5470
Loss = 1.5925e-02, PNorm = 399.4507, GNorm = 0.1721, lr_0 = 9.9632e-04
Validation auc = 0.702684
Epoch 5471
Loss = 3.7752e-02, PNorm = 399.4764, GNorm = 2.1427, lr_0 = 9.9632e-04
Validation auc = 0.704865
Epoch 5472
Loss = 8.1692e-03, PNorm = 399.5074, GNorm = 0.0896, lr_0 = 9.9632e-04
Validation auc = 0.705267
Epoch 5473
Loss = 2.4604e-02, PNorm = 399.5327, GNorm = 0.4577, lr_0 = 9.9632e-04
Validation auc = 0.699140
Epoch 5474
Loss = 1.1237e-02, PNorm = 399.5562, GNorm = 1.0282, lr_0 = 9.9632e-04
Validation auc = 0.693452
Epoch 5475
Loss = 1.2979e-02, PNorm = 399.5755, GNorm = 0.2313, lr_0 = 9.9632e-04
Validation auc = 0.687173
Epoch 5476
Loss = 7.6875e-03, PNorm = 399.5979, GNorm = 0.1898, lr_0 = 9.9632e-04
Validation auc = 0.688799
Epoch 5477
Loss = 1.2998e-02, PNorm = 399.6226, GNorm = 0.7368, lr_0 = 9.9632e-04
Validation auc = 0.682722
Epoch 5478
Loss = 4.6103e-03, PNorm = 399.6443, GNorm = 0.0757, lr_0 = 9.9632e-04
Validation auc = 0.683019
Epoch 5479
Loss = 1.8878e-01, PNorm = 399.6642, GNorm = 3.1963, lr_0 = 9.9632e-04
Loss = 2.1249e-02, PNorm = 399.6882, GNorm = 0.5552, lr_0 = 9.9632e-04
Validation auc = 0.681287
Epoch 5480
Loss = 1.6386e-02, PNorm = 399.7140, GNorm = 1.9370, lr_0 = 9.9632e-04
Validation auc = 0.678609
Epoch 5481
Loss = 8.0377e-03, PNorm = 399.7389, GNorm = 0.0383, lr_0 = 9.9632e-04
Validation auc = 0.681507
Epoch 5482
Loss = 1.6323e-02, PNorm = 399.7593, GNorm = 0.0486, lr_0 = 9.9631e-04
Validation auc = 0.677219
Epoch 5483
Loss = 2.1386e-03, PNorm = 399.7788, GNorm = 0.9936, lr_0 = 9.9631e-04
Validation auc = 0.675820
Epoch 5484
Loss = 6.2819e-03, PNorm = 399.7921, GNorm = 0.1167, lr_0 = 9.9631e-04
Validation auc = 0.672934
Epoch 5485
Loss = 1.0110e-02, PNorm = 399.8087, GNorm = 0.6881, lr_0 = 9.9631e-04
Validation auc = 0.672954
Epoch 5486
Loss = 2.6019e-02, PNorm = 399.8356, GNorm = 0.1969, lr_0 = 9.9631e-04
Validation auc = 0.670670
Epoch 5487
Loss = 2.0409e-02, PNorm = 399.8641, GNorm = 1.9335, lr_0 = 9.9631e-04
Validation auc = 0.666157
Epoch 5488
Loss = 2.0006e-02, PNorm = 399.9048, GNorm = 0.1925, lr_0 = 9.9631e-04
Validation auc = 0.667860
Epoch 5489
Loss = 5.0025e-03, PNorm = 399.9430, GNorm = 0.1375, lr_0 = 9.9631e-04
Loss = 1.0759e-02, PNorm = 399.9763, GNorm = 0.0596, lr_0 = 9.9631e-04
Validation auc = 0.672934
Epoch 5490
Loss = 2.8911e-02, PNorm = 400.0014, GNorm = 2.5084, lr_0 = 9.9631e-04
Validation auc = 0.674131
Epoch 5491
Loss = 1.1583e-02, PNorm = 400.0366, GNorm = 1.1696, lr_0 = 9.9631e-04
Validation auc = 0.675931
Epoch 5492
Loss = 9.6374e-03, PNorm = 400.0650, GNorm = 0.2340, lr_0 = 9.9631e-04
Validation auc = 0.679235
Epoch 5493
Loss = 1.7635e-02, PNorm = 400.0855, GNorm = 1.2179, lr_0 = 9.9631e-04
Validation auc = 0.680329
Epoch 5494
Loss = 2.3558e-02, PNorm = 400.1024, GNorm = 1.1407, lr_0 = 9.9631e-04
Validation auc = 0.684707
Epoch 5495
Loss = 4.7273e-03, PNorm = 400.1233, GNorm = 0.0505, lr_0 = 9.9631e-04
Validation auc = 0.686570
Epoch 5496
Loss = 3.7542e-02, PNorm = 400.1441, GNorm = 0.0641, lr_0 = 9.9630e-04
Validation auc = 0.689705
Epoch 5497
Loss = 2.2249e-02, PNorm = 400.1626, GNorm = 2.4736, lr_0 = 9.9630e-04
Validation auc = 0.691305
Epoch 5498
Loss = 4.6883e-03, PNorm = 400.1946, GNorm = 0.1230, lr_0 = 9.9630e-04
Validation auc = 0.685090
Epoch 5499
Loss = 2.5473e-02, PNorm = 400.2265, GNorm = 0.8327, lr_0 = 9.9630e-04
Loss = 9.4677e-03, PNorm = 400.2530, GNorm = 0.3056, lr_0 = 9.9630e-04
Validation auc = 0.682387
Epoch 5500
Loss = 3.3151e-02, PNorm = 400.2845, GNorm = 0.3758, lr_0 = 9.9630e-04
Validation auc = 0.678146
Epoch 5501
Loss = 1.1333e-02, PNorm = 400.3114, GNorm = 0.1667, lr_0 = 9.9630e-04
Validation auc = 0.681048
Epoch 5502
Loss = 2.0375e-02, PNorm = 400.3407, GNorm = 0.1489, lr_0 = 9.9630e-04
Validation auc = 0.682379
Epoch 5503
Loss = 2.6128e-02, PNorm = 400.3697, GNorm = 1.4943, lr_0 = 9.9630e-04
Validation auc = 0.675602
Epoch 5504
Loss = 4.1462e-02, PNorm = 400.3989, GNorm = 0.9136, lr_0 = 9.9630e-04
Validation auc = 0.670716
Epoch 5505
Loss = 5.1308e-02, PNorm = 400.4299, GNorm = 1.7622, lr_0 = 9.9630e-04
Validation auc = 0.679845
Epoch 5506
Loss = 2.6900e-02, PNorm = 400.4587, GNorm = 0.8851, lr_0 = 9.9630e-04
Validation auc = 0.687792
Epoch 5507
Loss = 1.0085e-02, PNorm = 400.4915, GNorm = 0.8395, lr_0 = 9.9630e-04
Validation auc = 0.691939
Epoch 5508
Loss = 4.5560e-02, PNorm = 400.5158, GNorm = 1.5319, lr_0 = 9.9630e-04
Validation auc = 0.693566
Epoch 5509
Loss = 9.3275e-04, PNorm = 400.5386, GNorm = 0.0394, lr_0 = 9.9630e-04
Loss = 5.4577e-03, PNorm = 400.5570, GNorm = 0.0456, lr_0 = 9.9629e-04
Validation auc = 0.697739
Epoch 5510
Loss = 1.1058e-02, PNorm = 400.5700, GNorm = 0.1485, lr_0 = 9.9629e-04
Validation auc = 0.702158
Epoch 5511
Loss = 2.6767e-02, PNorm = 400.5865, GNorm = 0.2197, lr_0 = 9.9629e-04
Validation auc = 0.698418
Epoch 5512
Loss = 2.5447e-02, PNorm = 400.6131, GNorm = 0.2445, lr_0 = 9.9629e-04
Validation auc = 0.691382
Epoch 5513
Loss = 1.0510e-02, PNorm = 400.6374, GNorm = 1.6898, lr_0 = 9.9629e-04
Validation auc = 0.686574
Epoch 5514
Loss = 3.7135e-02, PNorm = 400.6581, GNorm = 0.1476, lr_0 = 9.9629e-04
Validation auc = 0.682726
Epoch 5515
Loss = 5.4958e-03, PNorm = 400.6791, GNorm = 0.2385, lr_0 = 9.9629e-04
Validation auc = 0.683875
Epoch 5516
Loss = 1.8276e-03, PNorm = 400.6937, GNorm = 0.0516, lr_0 = 9.9629e-04
Validation auc = 0.681602
Epoch 5517
Loss = 5.9037e-02, PNorm = 400.7186, GNorm = 2.7684, lr_0 = 9.9629e-04
Validation auc = 0.680249
Epoch 5518
Loss = 7.8461e-03, PNorm = 400.7656, GNorm = 0.5214, lr_0 = 9.9629e-04
Validation auc = 0.684077
Epoch 5519
Loss = 4.2642e-03, PNorm = 400.8022, GNorm = 0.1845, lr_0 = 9.9629e-04
Loss = 1.4566e-02, PNorm = 400.8285, GNorm = 0.9077, lr_0 = 9.9629e-04
Validation auc = 0.682737
Epoch 5520
Loss = 2.4401e-02, PNorm = 400.8567, GNorm = 0.9196, lr_0 = 9.9629e-04
Validation auc = 0.681725
Epoch 5521
Loss = 5.7726e-03, PNorm = 400.8846, GNorm = 0.4519, lr_0 = 9.9629e-04
Validation auc = 0.681479
Epoch 5522
Loss = 2.9993e-02, PNorm = 400.9084, GNorm = 1.7806, lr_0 = 9.9628e-04
Validation auc = 0.695203
Epoch 5523
Loss = 9.5393e-03, PNorm = 400.9379, GNorm = 0.0398, lr_0 = 9.9628e-04
Validation auc = 0.686626
Epoch 5524
Loss = 4.0477e-02, PNorm = 400.9736, GNorm = 5.4874, lr_0 = 9.9628e-04
Validation auc = 0.685751
Epoch 5525
Loss = 2.6107e-03, PNorm = 401.0174, GNorm = 0.0818, lr_0 = 9.9628e-04
Validation auc = 0.681791
Epoch 5526
Loss = 3.8424e-02, PNorm = 401.0462, GNorm = 1.3380, lr_0 = 9.9628e-04
Validation auc = 0.683450
Epoch 5527
Loss = 5.4763e-03, PNorm = 401.0859, GNorm = 0.2335, lr_0 = 9.9628e-04
Validation auc = 0.685522
Epoch 5528
Loss = 1.0639e-02, PNorm = 401.1210, GNorm = 0.1522, lr_0 = 9.9628e-04
Validation auc = 0.690013
Epoch 5529
Loss = 3.5688e-03, PNorm = 401.1529, GNorm = 0.3867, lr_0 = 9.9628e-04
Loss = 2.9803e-03, PNorm = 401.1802, GNorm = 0.0452, lr_0 = 9.9628e-04
Validation auc = 0.691755
Epoch 5530
Loss = 1.4258e-02, PNorm = 401.2012, GNorm = 0.0403, lr_0 = 9.9628e-04
Validation auc = 0.692723
Epoch 5531
Loss = 2.9377e-02, PNorm = 401.2281, GNorm = 0.4141, lr_0 = 9.9628e-04
Validation auc = 0.693032
Epoch 5532
Loss = 2.9284e-02, PNorm = 401.2804, GNorm = 0.3712, lr_0 = 9.9628e-04
Validation auc = 0.706297
Epoch 5533
Loss = 5.5706e-02, PNorm = 401.3385, GNorm = 1.5537, lr_0 = 9.9628e-04
Validation auc = 0.709896
Epoch 5534
Loss = 3.1777e-02, PNorm = 401.3926, GNorm = 0.3007, lr_0 = 9.9628e-04
Validation auc = 0.713312
Epoch 5535
Loss = 3.1039e-02, PNorm = 401.4384, GNorm = 1.1423, lr_0 = 9.9628e-04
Validation auc = 0.715475
Epoch 5536
Loss = 7.0068e-03, PNorm = 401.4842, GNorm = 0.1212, lr_0 = 9.9627e-04
Validation auc = 0.718229
Epoch 5537
Loss = 4.9486e-03, PNorm = 401.5206, GNorm = 0.4482, lr_0 = 9.9627e-04
Validation auc = 0.716525
Epoch 5538
Loss = 3.7840e-02, PNorm = 401.5440, GNorm = 0.8687, lr_0 = 9.9627e-04
Validation auc = 0.715551
Epoch 5539
Loss = 2.5275e-03, PNorm = 401.5764, GNorm = 0.0892, lr_0 = 9.9627e-04
Loss = 1.4772e-02, PNorm = 401.6093, GNorm = 0.2113, lr_0 = 9.9627e-04
Validation auc = 0.713280
Epoch 5540
Loss = 3.0927e-02, PNorm = 401.6340, GNorm = 1.6962, lr_0 = 9.9627e-04
Validation auc = 0.711359
Epoch 5541
Loss = 4.7054e-02, PNorm = 401.6624, GNorm = 0.2565, lr_0 = 9.9627e-04
Validation auc = 0.710792
Epoch 5542
Loss = 2.2119e-02, PNorm = 401.6922, GNorm = 0.0755, lr_0 = 9.9627e-04
Validation auc = 0.711147
Epoch 5543
Loss = 4.3715e-02, PNorm = 401.7176, GNorm = 0.0815, lr_0 = 9.9627e-04
Validation auc = 0.710670
Epoch 5544
Loss = 2.2484e-02, PNorm = 401.7550, GNorm = 0.1912, lr_0 = 9.9627e-04
Validation auc = 0.699970
Epoch 5545
Loss = 3.2091e-02, PNorm = 401.7971, GNorm = 0.4345, lr_0 = 9.9627e-04
Validation auc = 0.696164
Epoch 5546
Loss = 4.2717e-02, PNorm = 401.8416, GNorm = 0.0929, lr_0 = 9.9627e-04
Validation auc = 0.706543
Epoch 5547
Loss = 7.2136e-03, PNorm = 401.8859, GNorm = 0.0980, lr_0 = 9.9627e-04
Validation auc = 0.711926
Epoch 5548
Loss = 2.1633e-03, PNorm = 401.9264, GNorm = 0.2201, lr_0 = 9.9627e-04
Validation auc = 0.708674
Epoch 5549
Loss = 3.2844e-02, PNorm = 401.9597, GNorm = 1.2903, lr_0 = 9.9626e-04
Loss = 2.6733e-02, PNorm = 402.0037, GNorm = 1.9681, lr_0 = 9.9626e-04
Validation auc = 0.708789
Epoch 5550
Loss = 8.7338e-02, PNorm = 402.0671, GNorm = 2.1815, lr_0 = 9.9626e-04
Validation auc = 0.708780
Epoch 5551
Loss = 3.1376e-02, PNorm = 402.1300, GNorm = 0.5727, lr_0 = 9.9626e-04
Validation auc = 0.704215
Epoch 5552
Loss = 4.6531e-02, PNorm = 402.1861, GNorm = 0.6061, lr_0 = 9.9626e-04
Validation auc = 0.708103
Epoch 5553
Loss = 2.6485e-02, PNorm = 402.2326, GNorm = 1.1287, lr_0 = 9.9626e-04
Validation auc = 0.704870
Epoch 5554
Loss = 1.8466e-02, PNorm = 402.2726, GNorm = 1.0098, lr_0 = 9.9626e-04
Validation auc = 0.699918
Epoch 5555
Loss = 3.5739e-02, PNorm = 402.3049, GNorm = 1.4195, lr_0 = 9.9626e-04
Validation auc = 0.698606
Epoch 5556
Loss = 1.3229e-01, PNorm = 402.3326, GNorm = 6.7008, lr_0 = 9.9626e-04
Validation auc = 0.691371
Epoch 5557
Loss = 8.5525e-03, PNorm = 402.3785, GNorm = 0.7745, lr_0 = 9.9626e-04
Validation auc = 0.685578
Epoch 5558
Loss = 2.0380e-02, PNorm = 402.4147, GNorm = 0.0627, lr_0 = 9.9626e-04
Validation auc = 0.688999
Epoch 5559
Loss = 3.8128e-02, PNorm = 402.4422, GNorm = 1.4019, lr_0 = 9.9626e-04
Loss = 6.2199e-03, PNorm = 402.4740, GNorm = 0.2143, lr_0 = 9.9626e-04
Validation auc = 0.694298
Epoch 5560
Loss = 3.1903e-02, PNorm = 402.4967, GNorm = 2.2662, lr_0 = 9.9626e-04
Validation auc = 0.702363
Epoch 5561
Loss = 2.8236e-02, PNorm = 402.5222, GNorm = 0.1111, lr_0 = 9.9626e-04
Validation auc = 0.705349
Epoch 5562
Loss = 2.3870e-02, PNorm = 402.5554, GNorm = 2.6600, lr_0 = 9.9625e-04
Validation auc = 0.713241
Epoch 5563
Loss = 3.2108e-02, PNorm = 402.5981, GNorm = 0.0647, lr_0 = 9.9625e-04
Validation auc = 0.725049
Epoch 5564
Loss = 1.2521e-01, PNorm = 402.6518, GNorm = 7.4391, lr_0 = 9.9625e-04
Validation auc = 0.728101
Epoch 5565
Loss = 4.9690e-02, PNorm = 402.7263, GNorm = 2.0528, lr_0 = 9.9625e-04
Validation auc = 0.728365
Epoch 5566
Loss = 5.9514e-02, PNorm = 402.7918, GNorm = 0.4421, lr_0 = 9.9625e-04
Validation auc = 0.715977
Epoch 5567
Loss = 1.1910e-02, PNorm = 402.8499, GNorm = 0.3861, lr_0 = 9.9625e-04
Validation auc = 0.713101
Epoch 5568
Loss = 1.9585e-02, PNorm = 402.8950, GNorm = 0.0753, lr_0 = 9.9625e-04
Validation auc = 0.714766
Epoch 5569
Loss = 6.5608e-02, PNorm = 402.9333, GNorm = 1.3368, lr_0 = 9.9625e-04
Loss = 3.6300e-02, PNorm = 402.9747, GNorm = 0.2123, lr_0 = 9.9625e-04
Validation auc = 0.710177
Epoch 5570
Loss = 6.0008e-02, PNorm = 403.0155, GNorm = 0.3354, lr_0 = 9.9625e-04
Validation auc = 0.717711
Epoch 5571
Loss = 1.1381e-02, PNorm = 403.0531, GNorm = 0.6523, lr_0 = 9.9625e-04
Validation auc = 0.724726
Epoch 5572
Loss = 1.7665e-02, PNorm = 403.0876, GNorm = 0.2373, lr_0 = 9.9625e-04
Validation auc = 0.725467
Epoch 5573
Loss = 2.1909e-02, PNorm = 403.1159, GNorm = 0.3118, lr_0 = 9.9625e-04
Validation auc = 0.719270
Epoch 5574
Loss = 3.3785e-02, PNorm = 403.1459, GNorm = 0.5283, lr_0 = 9.9625e-04
Validation auc = 0.714200
Epoch 5575
Loss = 2.8546e-02, PNorm = 403.1830, GNorm = 1.3512, lr_0 = 9.9625e-04
Validation auc = 0.709583
Epoch 5576
Loss = 1.4458e-02, PNorm = 403.2218, GNorm = 0.1611, lr_0 = 9.9624e-04
Validation auc = 0.719715
Epoch 5577
Loss = 3.0957e-02, PNorm = 403.2540, GNorm = 0.0831, lr_0 = 9.9624e-04
Validation auc = 0.724777
Epoch 5578
Loss = 6.3246e-02, PNorm = 403.2803, GNorm = 0.0618, lr_0 = 9.9624e-04
Validation auc = 0.719895
Epoch 5579
Loss = 9.7963e-03, PNorm = 403.3077, GNorm = 0.8415, lr_0 = 9.9624e-04
Loss = 8.7645e-03, PNorm = 403.3348, GNorm = 0.0403, lr_0 = 9.9624e-04
Validation auc = 0.712855
Epoch 5580
Loss = 4.8066e-02, PNorm = 403.3631, GNorm = 0.0431, lr_0 = 9.9624e-04
Validation auc = 0.707956
Epoch 5581
Loss = 2.6930e-02, PNorm = 403.3992, GNorm = 0.4129, lr_0 = 9.9624e-04
Validation auc = 0.700475
Epoch 5582
Loss = 4.2532e-02, PNorm = 403.4292, GNorm = 2.0950, lr_0 = 9.9624e-04
Validation auc = 0.698543
Epoch 5583
Loss = 3.0693e-02, PNorm = 403.4593, GNorm = 0.8917, lr_0 = 9.9624e-04
Validation auc = 0.693272
Epoch 5584
Loss = 2.8092e-02, PNorm = 403.4992, GNorm = 0.9891, lr_0 = 9.9624e-04
Validation auc = 0.694524
Epoch 5585
Loss = 3.9831e-02, PNorm = 403.5464, GNorm = 2.2981, lr_0 = 9.9624e-04
Validation auc = 0.695213
Epoch 5586
Loss = 5.0760e-02, PNorm = 403.5884, GNorm = 0.1451, lr_0 = 9.9624e-04
Validation auc = 0.708278
Epoch 5587
Loss = 3.0727e-03, PNorm = 403.6310, GNorm = 0.1577, lr_0 = 9.9624e-04
Validation auc = 0.715461
Epoch 5588
Loss = 1.4590e-02, PNorm = 403.6644, GNorm = 0.1165, lr_0 = 9.9624e-04
Validation auc = 0.711639
Epoch 5589
Loss = 7.5608e-02, PNorm = 403.7017, GNorm = 1.2453, lr_0 = 9.9623e-04
Loss = 1.8103e-02, PNorm = 403.7408, GNorm = 0.0831, lr_0 = 9.9623e-04
Validation auc = 0.707064
Epoch 5590
Loss = 2.2098e-02, PNorm = 403.7715, GNorm = 0.7798, lr_0 = 9.9623e-04
Validation auc = 0.702367
Epoch 5591
Loss = 2.8282e-02, PNorm = 403.7965, GNorm = 2.3589, lr_0 = 9.9623e-04
Validation auc = 0.699888
Epoch 5592
Loss = 2.2078e-02, PNorm = 403.8330, GNorm = 0.1365, lr_0 = 9.9623e-04
Validation auc = 0.706790
Epoch 5593
Loss = 3.2117e-02, PNorm = 403.8726, GNorm = 0.0351, lr_0 = 9.9623e-04
Validation auc = 0.705547
Epoch 5594
Loss = 4.9961e-02, PNorm = 403.9081, GNorm = 2.4928, lr_0 = 9.9623e-04
Validation auc = 0.706059
Epoch 5595
Loss = 3.6853e-02, PNorm = 403.9349, GNorm = 1.8541, lr_0 = 9.9623e-04
Validation auc = 0.706781
Epoch 5596
Loss = 1.9209e-02, PNorm = 403.9672, GNorm = 0.3689, lr_0 = 9.9623e-04
Validation auc = 0.712932
Epoch 5597
Loss = 7.5988e-02, PNorm = 404.0027, GNorm = 0.7128, lr_0 = 9.9623e-04
Validation auc = 0.704456
Epoch 5598
Loss = 6.6812e-03, PNorm = 404.0515, GNorm = 0.2402, lr_0 = 9.9623e-04
Validation auc = 0.703925
Epoch 5599
Loss = 2.7382e-03, PNorm = 404.0905, GNorm = 0.1305, lr_0 = 9.9623e-04
Loss = 3.8699e-02, PNorm = 404.1198, GNorm = 1.6795, lr_0 = 9.9623e-04
Validation auc = 0.704535
Epoch 5600
Loss = 1.0798e-02, PNorm = 404.1535, GNorm = 0.4155, lr_0 = 9.9623e-04
Validation auc = 0.707795
Epoch 5601
Loss = 4.5904e-02, PNorm = 404.1925, GNorm = 1.3420, lr_0 = 9.9623e-04
Validation auc = 0.716202
Epoch 5602
Loss = 6.9297e-03, PNorm = 404.2307, GNorm = 0.7224, lr_0 = 9.9622e-04
Validation auc = 0.717235
Epoch 5603
Loss = 4.4083e-02, PNorm = 404.2583, GNorm = 0.2917, lr_0 = 9.9622e-04
Validation auc = 0.718869
Epoch 5604
Loss = 1.3086e-02, PNorm = 404.2867, GNorm = 0.1481, lr_0 = 9.9622e-04
Validation auc = 0.713800
Epoch 5605
Loss = 1.2121e-01, PNorm = 404.3320, GNorm = 1.3980, lr_0 = 9.9622e-04
Validation auc = 0.721730
Epoch 5606
Loss = 1.4583e-02, PNorm = 404.3892, GNorm = 1.5136, lr_0 = 9.9622e-04
Validation auc = 0.722824
Epoch 5607
Loss = 1.2365e-03, PNorm = 404.4344, GNorm = 0.0470, lr_0 = 9.9622e-04
Validation auc = 0.726231
Epoch 5608
Loss = 7.2747e-02, PNorm = 404.4710, GNorm = 0.2872, lr_0 = 9.9622e-04
Validation auc = 0.727514
Epoch 5609
Loss = 4.7167e-03, PNorm = 404.5195, GNorm = 0.1771, lr_0 = 9.9622e-04
Loss = 3.3616e-02, PNorm = 404.5762, GNorm = 1.3681, lr_0 = 9.9622e-04
Validation auc = 0.720154
Epoch 5610
Loss = 5.6633e-02, PNorm = 404.6312, GNorm = 1.4256, lr_0 = 9.9622e-04
Validation auc = 0.720385
Epoch 5611
Loss = 3.2629e-02, PNorm = 404.6773, GNorm = 0.2076, lr_0 = 9.9622e-04
Validation auc = 0.729196
Epoch 5612
Loss = 6.2888e-02, PNorm = 404.7136, GNorm = 2.1356, lr_0 = 9.9622e-04
Validation auc = 0.738730
Epoch 5613
Loss = 1.4443e-02, PNorm = 404.7607, GNorm = 0.1509, lr_0 = 9.9622e-04
Validation auc = 0.740158
Epoch 5614
Loss = 2.9833e-02, PNorm = 404.7935, GNorm = 0.7113, lr_0 = 9.9622e-04
Validation auc = 0.744928
Epoch 5615
Loss = 6.1551e-02, PNorm = 404.8254, GNorm = 1.7262, lr_0 = 9.9621e-04
Validation auc = 0.752007
Epoch 5616
Loss = 1.3345e-02, PNorm = 404.8617, GNorm = 0.5008, lr_0 = 9.9621e-04
Validation auc = 0.755362
Epoch 5617
Loss = 2.1957e-02, PNorm = 404.8927, GNorm = 0.2544, lr_0 = 9.9621e-04
Validation auc = 0.752158
Epoch 5618
Loss = 2.9463e-02, PNorm = 404.9233, GNorm = 0.2801, lr_0 = 9.9621e-04
Validation auc = 0.751051
Epoch 5619
Loss = 1.1898e-02, PNorm = 404.9493, GNorm = 0.3102, lr_0 = 9.9621e-04
Loss = 1.6779e-02, PNorm = 404.9768, GNorm = 0.9495, lr_0 = 9.9621e-04
Validation auc = 0.749153
Epoch 5620
Loss = 6.2489e-03, PNorm = 404.9971, GNorm = 0.1079, lr_0 = 9.9621e-04
Validation auc = 0.746477
Epoch 5621
Loss = 8.2273e-02, PNorm = 405.0209, GNorm = 0.3719, lr_0 = 9.9621e-04
Validation auc = 0.739448
Epoch 5622
Loss = 5.4869e-02, PNorm = 405.0549, GNorm = 0.5257, lr_0 = 9.9621e-04
Validation auc = 0.728264
Epoch 5623
Loss = 4.3028e-02, PNorm = 405.0911, GNorm = 0.1303, lr_0 = 9.9621e-04
Validation auc = 0.720248
Epoch 5624
Loss = 1.4398e-02, PNorm = 405.1234, GNorm = 0.4636, lr_0 = 9.9621e-04
Validation auc = 0.720032
Epoch 5625
Loss = 4.9003e-02, PNorm = 405.1544, GNorm = 0.6213, lr_0 = 9.9621e-04
Validation auc = 0.722542
Epoch 5626
Loss = 1.5283e-02, PNorm = 405.1793, GNorm = 0.9833, lr_0 = 9.9621e-04
Validation auc = 0.722283
Epoch 5627
Loss = 1.0007e-02, PNorm = 405.1980, GNorm = 0.0840, lr_0 = 9.9621e-04
Validation auc = 0.722790
Epoch 5628
Loss = 2.2088e-03, PNorm = 405.2172, GNorm = 0.0942, lr_0 = 9.9621e-04
Validation auc = 0.718817
Epoch 5629
Loss = 9.6186e-03, PNorm = 405.2389, GNorm = 0.6903, lr_0 = 9.9620e-04
Loss = 2.9149e-02, PNorm = 405.2691, GNorm = 0.1024, lr_0 = 9.9620e-04
Validation auc = 0.717094
Epoch 5630
Loss = 3.5486e-02, PNorm = 405.2953, GNorm = 3.6856, lr_0 = 9.9620e-04
Validation auc = 0.716908
Epoch 5631
Loss = 3.8917e-02, PNorm = 405.3504, GNorm = 0.7056, lr_0 = 9.9620e-04
Validation auc = 0.707309
Epoch 5632
Loss = 1.6372e-02, PNorm = 405.3973, GNorm = 0.0811, lr_0 = 9.9620e-04
Validation auc = 0.700070
Epoch 5633
Loss = 4.4402e-02, PNorm = 405.4370, GNorm = 1.2380, lr_0 = 9.9620e-04
Validation auc = 0.693577
Epoch 5634
Loss = 1.6056e-02, PNorm = 405.4848, GNorm = 1.2504, lr_0 = 9.9620e-04
Validation auc = 0.693390
Epoch 5635
Loss = 4.6264e-02, PNorm = 405.5300, GNorm = 0.2092, lr_0 = 9.9620e-04
Validation auc = 0.692863
Epoch 5636
Loss = 2.9635e-02, PNorm = 405.5816, GNorm = 0.1331, lr_0 = 9.9620e-04
Validation auc = 0.698919
Epoch 5637
Loss = 2.4569e-02, PNorm = 405.6361, GNorm = 1.4796, lr_0 = 9.9620e-04
Validation auc = 0.700477
Epoch 5638
Loss = 1.9226e-02, PNorm = 405.6861, GNorm = 1.4346, lr_0 = 9.9620e-04
Validation auc = 0.702055
Epoch 5639
Loss = 1.7053e-02, PNorm = 405.7275, GNorm = 1.2429, lr_0 = 9.9620e-04
Loss = 2.2446e-02, PNorm = 405.7558, GNorm = 0.3042, lr_0 = 9.9620e-04
Validation auc = 0.711310
Epoch 5640
Loss = 1.4334e-02, PNorm = 405.7907, GNorm = 0.0517, lr_0 = 9.9620e-04
Validation auc = 0.707755
Epoch 5641
Loss = 3.8080e-02, PNorm = 405.8210, GNorm = 3.4262, lr_0 = 9.9619e-04
Validation auc = 0.709400
Epoch 5642
Loss = 7.1803e-02, PNorm = 405.8617, GNorm = 3.9499, lr_0 = 9.9619e-04
Validation auc = 0.714630
Epoch 5643
Loss = 3.5778e-02, PNorm = 405.9147, GNorm = 1.7433, lr_0 = 9.9619e-04
Validation auc = 0.714827
Epoch 5644
Loss = 7.0244e-02, PNorm = 405.9588, GNorm = 0.0436, lr_0 = 9.9619e-04
Validation auc = 0.719378
Epoch 5645
Loss = 2.6804e-02, PNorm = 405.9992, GNorm = 1.6428, lr_0 = 9.9619e-04
Validation auc = 0.724080
Epoch 5646
Loss = 3.3659e-02, PNorm = 406.0371, GNorm = 1.7359, lr_0 = 9.9619e-04
Validation auc = 0.728944
Epoch 5647
Loss = 3.1439e-02, PNorm = 406.0739, GNorm = 1.0239, lr_0 = 9.9619e-04
Validation auc = 0.731511
Epoch 5648
Loss = 4.0781e-02, PNorm = 406.1053, GNorm = 2.2420, lr_0 = 9.9619e-04
Validation auc = 0.734609
Epoch 5649
Loss = 2.7445e-02, PNorm = 406.1423, GNorm = 1.6811, lr_0 = 9.9619e-04
Loss = 2.6684e-02, PNorm = 406.1825, GNorm = 0.0422, lr_0 = 9.9619e-04
Validation auc = 0.725537
Epoch 5650
Loss = 2.0476e-02, PNorm = 406.2177, GNorm = 0.1329, lr_0 = 9.9619e-04
Validation auc = 0.721494
Epoch 5651
Loss = 9.0083e-03, PNorm = 406.2406, GNorm = 0.3677, lr_0 = 9.9619e-04
Validation auc = 0.719517
Epoch 5652
Loss = 2.8592e-02, PNorm = 406.2599, GNorm = 1.5209, lr_0 = 9.9619e-04
Validation auc = 0.717437
Epoch 5653
Loss = 2.0545e-02, PNorm = 406.2876, GNorm = 1.4392, lr_0 = 9.9619e-04
Validation auc = 0.720046
Epoch 5654
Loss = 6.3375e-03, PNorm = 406.3265, GNorm = 0.2977, lr_0 = 9.9619e-04
Validation auc = 0.724985
Epoch 5655
Loss = 9.3636e-03, PNorm = 406.3560, GNorm = 0.2821, lr_0 = 9.9618e-04
Validation auc = 0.724459
Epoch 5656
Loss = 1.5148e-02, PNorm = 406.3790, GNorm = 0.1289, lr_0 = 9.9618e-04
Validation auc = 0.724990
Epoch 5657
Loss = 4.8301e-03, PNorm = 406.4051, GNorm = 0.0891, lr_0 = 9.9618e-04
Validation auc = 0.719816
Epoch 5658
Loss = 6.1567e-02, PNorm = 406.4364, GNorm = 2.2370, lr_0 = 9.9618e-04
Validation auc = 0.719656
Epoch 5659
Loss = 2.7399e-03, PNorm = 406.4673, GNorm = 0.1396, lr_0 = 9.9618e-04
Loss = 1.5935e-02, PNorm = 406.4906, GNorm = 0.0359, lr_0 = 9.9618e-04
Validation auc = 0.714847
Epoch 5660
Loss = 5.4321e-02, PNorm = 406.5175, GNorm = 0.5384, lr_0 = 9.9618e-04
Validation auc = 0.713123
Epoch 5661
Loss = 1.5815e-02, PNorm = 406.5495, GNorm = 0.5961, lr_0 = 9.9618e-04
Validation auc = 0.712620
Epoch 5662
Loss = 2.8736e-02, PNorm = 406.5769, GNorm = 2.1383, lr_0 = 9.9618e-04
Validation auc = 0.710789
Epoch 5663
Loss = 2.2943e-02, PNorm = 406.6023, GNorm = 3.4660, lr_0 = 9.9618e-04
Validation auc = 0.712344
Epoch 5664
Loss = 5.1623e-02, PNorm = 406.6334, GNorm = 0.4294, lr_0 = 9.9618e-04
Validation auc = 0.710242
Epoch 5665
Loss = 1.6979e-02, PNorm = 406.6720, GNorm = 0.2304, lr_0 = 9.9618e-04
Validation auc = 0.700466
Epoch 5666
Loss = 1.3341e-02, PNorm = 406.7211, GNorm = 0.3606, lr_0 = 9.9618e-04
Validation auc = 0.696007
Epoch 5667
Loss = 2.3761e-02, PNorm = 406.7560, GNorm = 0.1767, lr_0 = 9.9618e-04
Validation auc = 0.688635
Epoch 5668
Loss = 2.3162e-02, PNorm = 406.7911, GNorm = 2.1235, lr_0 = 9.9618e-04
Validation auc = 0.687633
Epoch 5669
Loss = 1.5429e-01, PNorm = 406.8213, GNorm = 1.9333, lr_0 = 9.9617e-04
Loss = 3.3116e-02, PNorm = 406.8523, GNorm = 1.2294, lr_0 = 9.9617e-04
Validation auc = 0.695921
Epoch 5670
Loss = 3.5678e-02, PNorm = 406.8870, GNorm = 0.4308, lr_0 = 9.9617e-04
Validation auc = 0.693954
Epoch 5671
Loss = 2.7330e-02, PNorm = 406.9225, GNorm = 0.4520, lr_0 = 9.9617e-04
Validation auc = 0.693288
Epoch 5672
Loss = 2.9788e-02, PNorm = 406.9515, GNorm = 0.0569, lr_0 = 9.9617e-04
Validation auc = 0.687331
Epoch 5673
Loss = 1.4342e-02, PNorm = 406.9857, GNorm = 0.2079, lr_0 = 9.9617e-04
Validation auc = 0.679933
Epoch 5674
Loss = 2.9388e-02, PNorm = 407.0185, GNorm = 4.1237, lr_0 = 9.9617e-04
Validation auc = 0.672931
Epoch 5675
Loss = 2.6318e-02, PNorm = 407.0545, GNorm = 1.0890, lr_0 = 9.9617e-04
Validation auc = 0.676660
Epoch 5676
Loss = 2.7590e-02, PNorm = 407.0925, GNorm = 1.8484, lr_0 = 9.9617e-04
Validation auc = 0.685749
Epoch 5677
Loss = 2.8570e-02, PNorm = 407.1337, GNorm = 0.6985, lr_0 = 9.9617e-04
Validation auc = 0.692827
Epoch 5678
Loss = 5.5209e-03, PNorm = 407.1668, GNorm = 0.0620, lr_0 = 9.9617e-04
Validation auc = 0.696326
Epoch 5679
Loss = 8.5436e-03, PNorm = 407.1862, GNorm = 0.2875, lr_0 = 9.9617e-04
Loss = 1.4343e-02, PNorm = 407.2071, GNorm = 0.5004, lr_0 = 9.9617e-04
Validation auc = 0.699271
Epoch 5680
Loss = 1.9661e-02, PNorm = 407.2319, GNorm = 0.0967, lr_0 = 9.9617e-04
Validation auc = 0.703219
Epoch 5681
Loss = 3.0028e-02, PNorm = 407.2572, GNorm = 0.0600, lr_0 = 9.9616e-04
Validation auc = 0.706463
Epoch 5682
Loss = 3.6234e-02, PNorm = 407.2937, GNorm = 0.2408, lr_0 = 9.9616e-04
Validation auc = 0.713289
Epoch 5683
Loss = 7.2325e-03, PNorm = 407.3267, GNorm = 0.0854, lr_0 = 9.9616e-04
Validation auc = 0.716310
Epoch 5684
Loss = 1.5110e-02, PNorm = 407.3457, GNorm = 0.1915, lr_0 = 9.9616e-04
Validation auc = 0.714571
Epoch 5685
Loss = 2.2323e-02, PNorm = 407.3603, GNorm = 1.7139, lr_0 = 9.9616e-04
Validation auc = 0.708007
Epoch 5686
Loss = 4.0749e-03, PNorm = 407.3774, GNorm = 0.0754, lr_0 = 9.9616e-04
Validation auc = 0.705277
Epoch 5687
Loss = 9.7860e-03, PNorm = 407.3934, GNorm = 0.0148, lr_0 = 9.9616e-04
Validation auc = 0.706424
Epoch 5688
Loss = 1.4561e-02, PNorm = 407.4105, GNorm = 1.7898, lr_0 = 9.9616e-04
Validation auc = 0.694879
Epoch 5689
Loss = 2.8870e-03, PNorm = 407.4360, GNorm = 0.2491, lr_0 = 9.9616e-04
Loss = 2.3481e-02, PNorm = 407.4646, GNorm = 2.9758, lr_0 = 9.9616e-04
Validation auc = 0.692531
Epoch 5690
Loss = 6.1705e-02, PNorm = 407.5119, GNorm = 1.7271, lr_0 = 9.9616e-04
Validation auc = 0.691698
Epoch 5691
Loss = 1.8961e-02, PNorm = 407.5643, GNorm = 1.0670, lr_0 = 9.9616e-04
Validation auc = 0.688567
Epoch 5692
Loss = 1.2102e-02, PNorm = 407.6020, GNorm = 0.2570, lr_0 = 9.9616e-04
Validation auc = 0.686805
Epoch 5693
Loss = 1.8653e-02, PNorm = 407.6318, GNorm = 0.8223, lr_0 = 9.9616e-04
Validation auc = 0.690393
Epoch 5694
Loss = 2.6475e-02, PNorm = 407.6653, GNorm = 0.0709, lr_0 = 9.9616e-04
Validation auc = 0.695524
Epoch 5695
Loss = 1.3127e-02, PNorm = 407.6983, GNorm = 0.0742, lr_0 = 9.9615e-04
Validation auc = 0.693899
Epoch 5696
Loss = 4.0285e-02, PNorm = 407.7178, GNorm = 3.0380, lr_0 = 9.9615e-04
Validation auc = 0.700327
Epoch 5697
Loss = 5.9043e-02, PNorm = 407.7383, GNorm = 4.9241, lr_0 = 9.9615e-04
Validation auc = 0.706502
Epoch 5698
Loss = 6.9228e-03, PNorm = 407.7686, GNorm = 0.0833, lr_0 = 9.9615e-04
Validation auc = 0.707041
Epoch 5699
Loss = 3.5953e-04, PNorm = 407.8014, GNorm = 0.0200, lr_0 = 9.9615e-04
Loss = 2.6674e-02, PNorm = 407.8333, GNorm = 2.7893, lr_0 = 9.9615e-04
Validation auc = 0.705743
Epoch 5700
Loss = 2.5621e-02, PNorm = 407.8674, GNorm = 0.1980, lr_0 = 9.9615e-04
Validation auc = 0.705281
Epoch 5701
Loss = 1.2042e-02, PNorm = 407.8969, GNorm = 0.7308, lr_0 = 9.9615e-04
Validation auc = 0.700473
Epoch 5702
Loss = 1.6017e-02, PNorm = 407.9362, GNorm = 0.2288, lr_0 = 9.9615e-04
Validation auc = 0.697803
Epoch 5703
Loss = 5.1863e-02, PNorm = 407.9748, GNorm = 1.9502, lr_0 = 9.9615e-04
Validation auc = 0.702560
Epoch 5704
Loss = 5.0798e-03, PNorm = 408.0161, GNorm = 1.9420, lr_0 = 9.9615e-04
Validation auc = 0.709921
Epoch 5705
Loss = 3.3749e-02, PNorm = 408.0479, GNorm = 0.1478, lr_0 = 9.9615e-04
Validation auc = 0.711771
Epoch 5706
Loss = 7.9504e-03, PNorm = 408.0701, GNorm = 0.6263, lr_0 = 9.9615e-04
Validation auc = 0.711926
Epoch 5707
Loss = 2.4753e-02, PNorm = 408.0892, GNorm = 0.7435, lr_0 = 9.9615e-04
Validation auc = 0.712661
Epoch 5708
Loss = 2.4391e-02, PNorm = 408.1052, GNorm = 0.3152, lr_0 = 9.9614e-04
Validation auc = 0.714460
Epoch 5709
Loss = 4.5256e-04, PNorm = 408.1246, GNorm = 0.0188, lr_0 = 9.9614e-04
Loss = 9.3012e-03, PNorm = 408.1417, GNorm = 0.2583, lr_0 = 9.9614e-04
Validation auc = 0.713817
Epoch 5710
Loss = 7.7719e-03, PNorm = 408.1564, GNorm = 0.0297, lr_0 = 9.9614e-04
Validation auc = 0.717694
Epoch 5711
Loss = 1.1230e-02, PNorm = 408.1683, GNorm = 0.0390, lr_0 = 9.9614e-04
Validation auc = 0.716721
Epoch 5712
Loss = 2.6000e-02, PNorm = 408.1853, GNorm = 0.5555, lr_0 = 9.9614e-04
Validation auc = 0.705427
Epoch 5713
Loss = 4.5461e-02, PNorm = 408.2173, GNorm = 2.2932, lr_0 = 9.9614e-04
Validation auc = 0.689435
Epoch 5714
Loss = 6.2910e-04, PNorm = 408.2538, GNorm = 0.0254, lr_0 = 9.9614e-04
Validation auc = 0.679072
Epoch 5715
Loss = 8.9411e-02, PNorm = 408.2843, GNorm = 0.5638, lr_0 = 9.9614e-04
Validation auc = 0.680545
Epoch 5716
Loss = 3.3687e-02, PNorm = 408.3298, GNorm = 1.7662, lr_0 = 9.9614e-04
Validation auc = 0.682375
Epoch 5717
Loss = 6.6488e-02, PNorm = 408.3651, GNorm = 0.7562, lr_0 = 9.9614e-04
Validation auc = 0.688771
Epoch 5718
Loss = 3.3946e-02, PNorm = 408.4015, GNorm = 3.8560, lr_0 = 9.9614e-04
Validation auc = 0.686703
Epoch 5719
Loss = 4.8145e-03, PNorm = 408.4439, GNorm = 0.2065, lr_0 = 9.9614e-04
Loss = 1.8743e-02, PNorm = 408.4839, GNorm = 0.2173, lr_0 = 9.9614e-04
Validation auc = 0.692848
Epoch 5720
Loss = 3.6786e-02, PNorm = 408.5277, GNorm = 0.2253, lr_0 = 9.9614e-04
Validation auc = 0.686236
Epoch 5721
Loss = 2.3616e-02, PNorm = 408.5654, GNorm = 2.4204, lr_0 = 9.9613e-04
Validation auc = 0.682107
Epoch 5722
Loss = 2.0533e-02, PNorm = 408.6084, GNorm = 1.1389, lr_0 = 9.9613e-04
Validation auc = 0.681117
Epoch 5723
Loss = 2.5758e-02, PNorm = 408.6516, GNorm = 0.4460, lr_0 = 9.9613e-04
Validation auc = 0.689519
Epoch 5724
Loss = 4.7251e-03, PNorm = 408.6992, GNorm = 0.9509, lr_0 = 9.9613e-04
Validation auc = 0.700240
Epoch 5725
Loss = 1.8034e-02, PNorm = 408.7534, GNorm = 0.4717, lr_0 = 9.9613e-04
Validation auc = 0.696829
Epoch 5726
Loss = 1.0564e-02, PNorm = 408.7952, GNorm = 1.1461, lr_0 = 9.9613e-04
Validation auc = 0.690210
Epoch 5727
Loss = 7.0296e-02, PNorm = 408.8303, GNorm = 0.0389, lr_0 = 9.9613e-04
Validation auc = 0.679358
Epoch 5728
Loss = 7.6026e-02, PNorm = 408.8860, GNorm = 3.2480, lr_0 = 9.9613e-04
Validation auc = 0.672277
Epoch 5729
Loss = 1.8651e-02, PNorm = 408.9483, GNorm = 0.6594, lr_0 = 9.9613e-04
Loss = 1.4539e-02, PNorm = 408.9982, GNorm = 0.4646, lr_0 = 9.9613e-04
Validation auc = 0.672463
Epoch 5730
Loss = 5.8021e-02, PNorm = 409.0429, GNorm = 0.0439, lr_0 = 9.9613e-04
Validation auc = 0.678915
Epoch 5731
Loss = 9.9985e-03, PNorm = 409.0884, GNorm = 0.2665, lr_0 = 9.9613e-04
Validation auc = 0.685531
Epoch 5732
Loss = 2.6540e-02, PNorm = 409.1269, GNorm = 0.0425, lr_0 = 9.9613e-04
Validation auc = 0.691684
Epoch 5733
Loss = 1.4859e-02, PNorm = 409.1672, GNorm = 0.0450, lr_0 = 9.9613e-04
Validation auc = 0.697548
Epoch 5734
Loss = 1.1138e-02, PNorm = 409.2002, GNorm = 0.4261, lr_0 = 9.9612e-04
Validation auc = 0.702084
Epoch 5735
Loss = 3.8433e-02, PNorm = 409.2272, GNorm = 0.1243, lr_0 = 9.9612e-04
Validation auc = 0.701572
Epoch 5736
Loss = 8.1066e-03, PNorm = 409.2620, GNorm = 0.6526, lr_0 = 9.9612e-04
Validation auc = 0.698103
Epoch 5737
Loss = 2.7374e-02, PNorm = 409.2944, GNorm = 0.0977, lr_0 = 9.9612e-04
Validation auc = 0.701735
Epoch 5738
Loss = 7.9980e-02, PNorm = 409.3203, GNorm = 8.2162, lr_0 = 9.9612e-04
Validation auc = 0.705830
Epoch 5739
Loss = 3.5372e-03, PNorm = 409.3578, GNorm = 0.0929, lr_0 = 9.9612e-04
Loss = 4.6397e-02, PNorm = 409.3901, GNorm = 1.4301, lr_0 = 9.9612e-04
Validation auc = 0.702830
Epoch 5740
Loss = 2.8526e-02, PNorm = 409.4252, GNorm = 1.0742, lr_0 = 9.9612e-04
Validation auc = 0.706276
Epoch 5741
Loss = 1.9173e-02, PNorm = 409.4578, GNorm = 0.1261, lr_0 = 9.9612e-04
Validation auc = 0.709304
Epoch 5742
Loss = 3.1969e-02, PNorm = 409.4929, GNorm = 1.8817, lr_0 = 9.9612e-04
Validation auc = 0.711952
Epoch 5743
Loss = 2.3199e-02, PNorm = 409.5295, GNorm = 1.5829, lr_0 = 9.9612e-04
Validation auc = 0.714002
Epoch 5744
Loss = 4.7953e-03, PNorm = 409.5633, GNorm = 0.0162, lr_0 = 9.9612e-04
Validation auc = 0.716012
Epoch 5745
Loss = 4.1036e-03, PNorm = 409.5876, GNorm = 0.0192, lr_0 = 9.9612e-04
Validation auc = 0.710703
Epoch 5746
Loss = 2.1457e-02, PNorm = 409.6109, GNorm = 0.4241, lr_0 = 9.9612e-04
Validation auc = 0.720074
Epoch 5747
Loss = 1.8096e-02, PNorm = 409.6496, GNorm = 0.0925, lr_0 = 9.9612e-04
Validation auc = 0.721661
Epoch 5748
Loss = 1.2578e-01, PNorm = 409.6904, GNorm = 5.1781, lr_0 = 9.9611e-04
Validation auc = 0.722418
Epoch 5749
Loss = 1.1224e-01, PNorm = 409.7335, GNorm = 1.4480, lr_0 = 9.9611e-04
Loss = 2.9333e-02, PNorm = 409.7675, GNorm = 1.0696, lr_0 = 9.9611e-04
Validation auc = 0.722824
Epoch 5750
Loss = 1.7377e-02, PNorm = 409.7962, GNorm = 2.0896, lr_0 = 9.9611e-04
Validation auc = 0.723084
Epoch 5751
Loss = 1.1478e-02, PNorm = 409.8182, GNorm = 0.2594, lr_0 = 9.9611e-04
Validation auc = 0.718907
Epoch 5752
Loss = 2.1279e-02, PNorm = 409.8451, GNorm = 0.0472, lr_0 = 9.9611e-04
Validation auc = 0.713473
Epoch 5753
Loss = 5.4683e-03, PNorm = 409.8776, GNorm = 1.6281, lr_0 = 9.9611e-04
Validation auc = 0.708498
Epoch 5754
Loss = 4.5509e-03, PNorm = 409.9043, GNorm = 0.0636, lr_0 = 9.9611e-04
Validation auc = 0.708527
Epoch 5755
Loss = 1.5305e-02, PNorm = 409.9228, GNorm = 0.1383, lr_0 = 9.9611e-04
Validation auc = 0.709733
Epoch 5756
Loss = 2.5895e-02, PNorm = 409.9395, GNorm = 0.0689, lr_0 = 9.9611e-04
Validation auc = 0.707986
Epoch 5757
Loss = 9.6012e-02, PNorm = 409.9663, GNorm = 2.0464, lr_0 = 9.9611e-04
Validation auc = 0.718992
Epoch 5758
Loss = 2.6382e-02, PNorm = 410.0197, GNorm = 0.0935, lr_0 = 9.9611e-04
Validation auc = 0.722255
Epoch 5759
Loss = 4.2461e-02, PNorm = 410.0659, GNorm = 2.5572, lr_0 = 9.9611e-04
Loss = 2.3568e-02, PNorm = 410.1068, GNorm = 2.4367, lr_0 = 9.9611e-04
Validation auc = 0.726620
Epoch 5760
Loss = 2.9618e-02, PNorm = 410.1500, GNorm = 1.3112, lr_0 = 9.9611e-04
Validation auc = 0.723844
Epoch 5761
Loss = 1.8546e-02, PNorm = 410.1920, GNorm = 0.1924, lr_0 = 9.9610e-04
Validation auc = 0.718640
Epoch 5762
Loss = 1.1070e-02, PNorm = 410.2340, GNorm = 0.1313, lr_0 = 9.9610e-04
Validation auc = 0.718031
Epoch 5763
Loss = 6.2001e-03, PNorm = 410.2640, GNorm = 0.0132, lr_0 = 9.9610e-04
Validation auc = 0.717746
Epoch 5764
Loss = 9.8217e-03, PNorm = 410.2850, GNorm = 0.3906, lr_0 = 9.9610e-04
Validation auc = 0.721092
Epoch 5765
Loss = 2.8322e-02, PNorm = 410.3054, GNorm = 0.0824, lr_0 = 9.9610e-04
Validation auc = 0.722659
Epoch 5766
Loss = 2.4618e-02, PNorm = 410.3369, GNorm = 1.0676, lr_0 = 9.9610e-04
Validation auc = 0.722548
Epoch 5767
Loss = 9.6414e-03, PNorm = 410.3608, GNorm = 0.1070, lr_0 = 9.9610e-04
Validation auc = 0.723017
Epoch 5768
Loss = 3.6542e-03, PNorm = 410.3829, GNorm = 0.0520, lr_0 = 9.9610e-04
Validation auc = 0.721072
Epoch 5769
Loss = 1.3997e-03, PNorm = 410.4064, GNorm = 0.0765, lr_0 = 9.9610e-04
Loss = 1.2745e-02, PNorm = 410.4343, GNorm = 0.0898, lr_0 = 9.9610e-04
Validation auc = 0.723136
Epoch 5770
Loss = 8.9375e-03, PNorm = 410.4615, GNorm = 0.3804, lr_0 = 9.9610e-04
Validation auc = 0.718239
Epoch 5771
Loss = 1.3912e-02, PNorm = 410.4829, GNorm = 0.2056, lr_0 = 9.9610e-04
Validation auc = 0.725002
Epoch 5772
Loss = 2.0986e-03, PNorm = 410.4980, GNorm = 0.1155, lr_0 = 9.9610e-04
Validation auc = 0.726719
Epoch 5773
Loss = 1.2861e-02, PNorm = 410.5114, GNorm = 0.0065, lr_0 = 9.9610e-04
Validation auc = 0.729604
Epoch 5774
Loss = 4.5126e-02, PNorm = 410.5407, GNorm = 0.3971, lr_0 = 9.9609e-04
Validation auc = 0.720975
Epoch 5775
Loss = 2.9288e-02, PNorm = 410.5793, GNorm = 0.1495, lr_0 = 9.9609e-04
Validation auc = 0.724343
Epoch 5776
Loss = 3.9494e-03, PNorm = 410.6179, GNorm = 0.1429, lr_0 = 9.9609e-04
Validation auc = 0.721651
Epoch 5777
Loss = 6.1025e-03, PNorm = 410.6457, GNorm = 0.1482, lr_0 = 9.9609e-04
Validation auc = 0.716658
Epoch 5778
Loss = 8.7030e-03, PNorm = 410.6704, GNorm = 0.3796, lr_0 = 9.9609e-04
Validation auc = 0.714570
Epoch 5779
Loss = 2.6298e-03, PNorm = 410.6958, GNorm = 0.1785, lr_0 = 9.9609e-04
Loss = 4.5641e-03, PNorm = 410.7157, GNorm = 0.0216, lr_0 = 9.9609e-04
Validation auc = 0.714493
Epoch 5780
Loss = 2.1680e-02, PNorm = 410.7351, GNorm = 1.0862, lr_0 = 9.9609e-04
Validation auc = 0.710201
Epoch 5781
Loss = 3.7957e-03, PNorm = 410.7525, GNorm = 0.0153, lr_0 = 9.9609e-04
Validation auc = 0.709051
Epoch 5782
Loss = 3.5138e-02, PNorm = 410.7680, GNorm = 0.3667, lr_0 = 9.9609e-04
Validation auc = 0.706779
Epoch 5783
Loss = 3.5261e-02, PNorm = 410.7963, GNorm = 2.3608, lr_0 = 9.9609e-04
Validation auc = 0.706126
Epoch 5784
Loss = 3.5842e-02, PNorm = 410.8347, GNorm = 0.1049, lr_0 = 9.9609e-04
Validation auc = 0.705251
Epoch 5785
Loss = 4.2238e-02, PNorm = 410.8794, GNorm = 0.0827, lr_0 = 9.9609e-04
Validation auc = 0.710816
Epoch 5786
Loss = 6.8111e-03, PNorm = 410.9155, GNorm = 0.0879, lr_0 = 9.9609e-04
Validation auc = 0.712057
Epoch 5787
Loss = 3.3901e-02, PNorm = 410.9418, GNorm = 0.0731, lr_0 = 9.9609e-04
Validation auc = 0.710447
Epoch 5788
Loss = 2.6909e-02, PNorm = 410.9652, GNorm = 0.1738, lr_0 = 9.9608e-04
Validation auc = 0.707067
Epoch 5789
Loss = 9.2319e-02, PNorm = 410.9978, GNorm = 2.1804, lr_0 = 9.9608e-04
Loss = 2.6595e-02, PNorm = 411.0409, GNorm = 0.5979, lr_0 = 9.9608e-04
Validation auc = 0.704936
Epoch 5790
Loss = 2.9140e-02, PNorm = 411.0851, GNorm = 0.1988, lr_0 = 9.9608e-04
Validation auc = 0.703122
Epoch 5791
Loss = 1.1943e-02, PNorm = 411.1202, GNorm = 1.0291, lr_0 = 9.9608e-04
Validation auc = 0.703321
Epoch 5792
Loss = 1.3320e-02, PNorm = 411.1489, GNorm = 0.0700, lr_0 = 9.9608e-04
Validation auc = 0.703128
Epoch 5793
Loss = 2.1789e-02, PNorm = 411.1756, GNorm = 0.9707, lr_0 = 9.9608e-04
Validation auc = 0.698653
Epoch 5794
Loss = 4.1724e-02, PNorm = 411.1968, GNorm = 0.0565, lr_0 = 9.9608e-04
Validation auc = 0.693535
Epoch 5795
Loss = 1.6006e-02, PNorm = 411.2174, GNorm = 0.1317, lr_0 = 9.9608e-04
Validation auc = 0.699774
Epoch 5796
Loss = 2.0803e-02, PNorm = 411.2400, GNorm = 1.7046, lr_0 = 9.9608e-04
Validation auc = 0.708771
Epoch 5797
Loss = 4.6098e-03, PNorm = 411.2630, GNorm = 0.3296, lr_0 = 9.9608e-04
Validation auc = 0.713340
Epoch 5798
Loss = 6.0288e-03, PNorm = 411.2849, GNorm = 1.3836, lr_0 = 9.9608e-04
Validation auc = 0.720086
Epoch 5799
Loss = 2.5490e-01, PNorm = 411.3064, GNorm = 2.8719, lr_0 = 9.9608e-04
Loss = 2.7266e-02, PNorm = 411.3382, GNorm = 0.3694, lr_0 = 9.9608e-04
Validation auc = 0.717753
Epoch 5800
Loss = 2.2574e-02, PNorm = 411.3777, GNorm = 1.4233, lr_0 = 9.9607e-04
Validation auc = 0.721834
Epoch 5801
Loss = 4.1136e-02, PNorm = 411.4129, GNorm = 0.9648, lr_0 = 9.9607e-04
Validation auc = 0.717093
Epoch 5802
Loss = 2.9061e-02, PNorm = 411.4438, GNorm = 0.4074, lr_0 = 9.9607e-04
Validation auc = 0.708626
Epoch 5803
Loss = 2.6945e-02, PNorm = 411.4718, GNorm = 0.8680, lr_0 = 9.9607e-04
Validation auc = 0.707976
Epoch 5804
Loss = 3.1548e-02, PNorm = 411.4975, GNorm = 0.9595, lr_0 = 9.9607e-04
Validation auc = 0.703892
Epoch 5805
Loss = 1.1093e-02, PNorm = 411.5251, GNorm = 0.3722, lr_0 = 9.9607e-04
Validation auc = 0.696852
Epoch 5806
Loss = 2.6613e-02, PNorm = 411.5474, GNorm = 0.1128, lr_0 = 9.9607e-04
Validation auc = 0.702451
Epoch 5807
Loss = 6.7604e-03, PNorm = 411.5684, GNorm = 0.0198, lr_0 = 9.9607e-04
Validation auc = 0.712039
Epoch 5808
Loss = 1.0261e-02, PNorm = 411.5891, GNorm = 0.3063, lr_0 = 9.9607e-04
Validation auc = 0.714194
Epoch 5809
Loss = 4.5420e-02, PNorm = 411.6076, GNorm = 1.9128, lr_0 = 9.9607e-04
Loss = 1.2898e-02, PNorm = 411.6306, GNorm = 0.0396, lr_0 = 9.9607e-04
Validation auc = 0.717156
Epoch 5810
Loss = 1.0620e-02, PNorm = 411.6534, GNorm = 0.1554, lr_0 = 9.9607e-04
Validation auc = 0.715242
Epoch 5811
Loss = 2.2950e-03, PNorm = 411.6690, GNorm = 0.7121, lr_0 = 9.9607e-04
Validation auc = 0.715080
Epoch 5812
Loss = 1.1936e-02, PNorm = 411.6805, GNorm = 0.1021, lr_0 = 9.9607e-04
Validation auc = 0.715220
Epoch 5813
Loss = 3.5598e-02, PNorm = 411.6973, GNorm = 0.1150, lr_0 = 9.9607e-04
Validation auc = 0.705870
Epoch 5814
Loss = 2.9716e-02, PNorm = 411.7311, GNorm = 1.7173, lr_0 = 9.9606e-04
Validation auc = 0.709991
Epoch 5815
Loss = 1.4003e-02, PNorm = 411.7721, GNorm = 0.0890, lr_0 = 9.9606e-04
Validation auc = 0.714257
Epoch 5816
Loss = 4.0614e-02, PNorm = 411.8074, GNorm = 1.9398, lr_0 = 9.9606e-04
Validation auc = 0.711438
Epoch 5817
Loss = 2.0219e-02, PNorm = 411.8500, GNorm = 0.0684, lr_0 = 9.9606e-04
Validation auc = 0.714378
Epoch 5818
Loss = 2.0068e-02, PNorm = 411.8882, GNorm = 1.6986, lr_0 = 9.9606e-04
Validation auc = 0.713501
Epoch 5819
Loss = 2.3211e-02, PNorm = 411.9161, GNorm = 0.8716, lr_0 = 9.9606e-04
Loss = 9.8304e-03, PNorm = 411.9401, GNorm = 0.0531, lr_0 = 9.9606e-04
Validation auc = 0.713314
Epoch 5820
Loss = 3.6431e-02, PNorm = 411.9728, GNorm = 0.0597, lr_0 = 9.9606e-04
Validation auc = 0.711425
Epoch 5821
Loss = 1.5689e-02, PNorm = 412.0104, GNorm = 0.7566, lr_0 = 9.9606e-04
Validation auc = 0.707753
Epoch 5822
Loss = 1.1188e-02, PNorm = 412.0400, GNorm = 0.4525, lr_0 = 9.9606e-04
Validation auc = 0.704504
Epoch 5823
Loss = 4.5532e-02, PNorm = 412.0590, GNorm = 0.0919, lr_0 = 9.9606e-04
Validation auc = 0.712760
Epoch 5824
Loss = 1.7388e-02, PNorm = 412.0842, GNorm = 0.1541, lr_0 = 9.9606e-04
Validation auc = 0.709754
Epoch 5825
Loss = 1.5327e-02, PNorm = 412.1158, GNorm = 0.0236, lr_0 = 9.9606e-04
Validation auc = 0.703961
Epoch 5826
Loss = 3.2702e-02, PNorm = 412.1435, GNorm = 2.0531, lr_0 = 9.9606e-04
Validation auc = 0.717476
Epoch 5827
Loss = 7.8843e-02, PNorm = 412.1841, GNorm = 2.7175, lr_0 = 9.9606e-04
Validation auc = 0.715478
Epoch 5828
Loss = 1.6992e-01, PNorm = 412.2342, GNorm = 6.3793, lr_0 = 9.9605e-04
Validation auc = 0.717420
Epoch 5829
Loss = 6.8487e-02, PNorm = 412.2897, GNorm = 2.2063, lr_0 = 9.9605e-04
Loss = 2.7310e-02, PNorm = 412.3369, GNorm = 1.3305, lr_0 = 9.9605e-04
Validation auc = 0.717735
Epoch 5830
Loss = 2.0789e-02, PNorm = 412.3745, GNorm = 1.0668, lr_0 = 9.9605e-04
Validation auc = 0.719220
Epoch 5831
Loss = 4.6559e-02, PNorm = 412.4074, GNorm = 0.3205, lr_0 = 9.9605e-04
Validation auc = 0.724817
Epoch 5832
Loss = 1.5506e-02, PNorm = 412.4431, GNorm = 0.6518, lr_0 = 9.9605e-04
Validation auc = 0.724915
Epoch 5833
Loss = 2.3936e-02, PNorm = 412.4760, GNorm = 0.0413, lr_0 = 9.9605e-04
Validation auc = 0.724261
Epoch 5834
Loss = 2.1525e-02, PNorm = 412.5043, GNorm = 1.4736, lr_0 = 9.9605e-04
Validation auc = 0.724314
Epoch 5835
Loss = 7.6217e-02, PNorm = 412.5443, GNorm = 3.4642, lr_0 = 9.9605e-04
Validation auc = 0.719966
Epoch 5836
Loss = 5.1872e-02, PNorm = 412.5951, GNorm = 0.4271, lr_0 = 9.9605e-04
Validation auc = 0.718319
Epoch 5837
Loss = 4.9991e-02, PNorm = 412.6388, GNorm = 1.4855, lr_0 = 9.9605e-04
Validation auc = 0.716353
Epoch 5838
Loss = 4.4450e-03, PNorm = 412.6733, GNorm = 0.1325, lr_0 = 9.9605e-04
Validation auc = 0.716566
Epoch 5839
Loss = 2.6914e-04, PNorm = 412.6996, GNorm = 0.0147, lr_0 = 9.9605e-04
Loss = 4.7233e-02, PNorm = 412.7219, GNorm = 1.9720, lr_0 = 9.9605e-04
Validation auc = 0.720250
Epoch 5840
Loss = 4.2161e-02, PNorm = 412.7592, GNorm = 4.6005, lr_0 = 9.9604e-04
Validation auc = 0.723689
Epoch 5841
Loss = 1.9119e-02, PNorm = 412.8041, GNorm = 0.0485, lr_0 = 9.9604e-04
Validation auc = 0.721848
Epoch 5842
Loss = 5.0210e-02, PNorm = 412.8394, GNorm = 0.1877, lr_0 = 9.9604e-04
Validation auc = 0.720327
Epoch 5843
Loss = 2.5784e-02, PNorm = 412.8687, GNorm = 0.0894, lr_0 = 9.9604e-04
Validation auc = 0.722765
Epoch 5844
Loss = 1.7234e-02, PNorm = 412.8971, GNorm = 0.3201, lr_0 = 9.9604e-04
Validation auc = 0.727316
Epoch 5845
Loss = 3.3940e-02, PNorm = 412.9239, GNorm = 1.9937, lr_0 = 9.9604e-04
Validation auc = 0.726443
Epoch 5846
Loss = 4.8418e-03, PNorm = 412.9582, GNorm = 0.1513, lr_0 = 9.9604e-04
Validation auc = 0.721987
Epoch 5847
Loss = 2.4784e-03, PNorm = 412.9887, GNorm = 0.0650, lr_0 = 9.9604e-04
Validation auc = 0.723515
Epoch 5848
Loss = 6.2000e-03, PNorm = 413.0114, GNorm = 0.6181, lr_0 = 9.9604e-04
Validation auc = 0.724580
Epoch 5849
Loss = 1.9588e-02, PNorm = 413.0394, GNorm = 1.2252, lr_0 = 9.9604e-04
Loss = 1.5155e-02, PNorm = 413.0714, GNorm = 0.3456, lr_0 = 9.9604e-04
Validation auc = 0.721454
Epoch 5850
Loss = 7.3051e-03, PNorm = 413.0947, GNorm = 0.6454, lr_0 = 9.9604e-04
Validation auc = 0.723537
Epoch 5851
Loss = 1.9029e-02, PNorm = 413.1138, GNorm = 0.0876, lr_0 = 9.9604e-04
Validation auc = 0.723472
Epoch 5852
Loss = 3.2031e-03, PNorm = 413.1317, GNorm = 0.3861, lr_0 = 9.9604e-04
Validation auc = 0.723621
Epoch 5853
Loss = 3.2336e-02, PNorm = 413.1531, GNorm = 0.6318, lr_0 = 9.9604e-04
Validation auc = 0.719121
Epoch 5854
Loss = 1.9892e-02, PNorm = 413.1892, GNorm = 0.8496, lr_0 = 9.9603e-04
Validation auc = 0.715747
Epoch 5855
Loss = 1.8946e-02, PNorm = 413.2293, GNorm = 1.7813, lr_0 = 9.9603e-04
Validation auc = 0.732065
Epoch 5856
Loss = 3.4443e-02, PNorm = 413.2911, GNorm = 1.3793, lr_0 = 9.9603e-04
Validation auc = 0.733585
Epoch 5857
Loss = 2.6316e-02, PNorm = 413.3491, GNorm = 1.4342, lr_0 = 9.9603e-04
Validation auc = 0.738046
Epoch 5858
Loss = 1.0948e-02, PNorm = 413.3909, GNorm = 0.5900, lr_0 = 9.9603e-04
Validation auc = 0.741830
Epoch 5859
Loss = 2.1314e-01, PNorm = 413.4246, GNorm = 4.3986, lr_0 = 9.9603e-04
Loss = 8.6305e-02, PNorm = 413.4780, GNorm = 0.1080, lr_0 = 9.9603e-04
Validation auc = 0.728187
Epoch 5860
Loss = 3.9041e-02, PNorm = 413.5287, GNorm = 0.7138, lr_0 = 9.9603e-04
Validation auc = 0.724546
Epoch 5861
Loss = 5.1063e-02, PNorm = 413.5745, GNorm = 0.5553, lr_0 = 9.9603e-04
Validation auc = 0.722752
Epoch 5862
Loss = 1.5546e-02, PNorm = 413.6102, GNorm = 1.4839, lr_0 = 9.9603e-04
Validation auc = 0.720022
Epoch 5863
Loss = 3.1924e-02, PNorm = 413.6346, GNorm = 0.0620, lr_0 = 9.9603e-04
Validation auc = 0.716984
Epoch 5864
Loss = 1.6050e-02, PNorm = 413.6611, GNorm = 0.5029, lr_0 = 9.9603e-04
Validation auc = 0.711374
Epoch 5865
Loss = 1.8040e-02, PNorm = 413.6897, GNorm = 0.1029, lr_0 = 9.9603e-04
Validation auc = 0.706862
Epoch 5866
Loss = 4.3771e-02, PNorm = 413.7099, GNorm = 0.1517, lr_0 = 9.9603e-04
Validation auc = 0.704639
Epoch 5867
Loss = 5.1709e-03, PNorm = 413.7245, GNorm = 0.0714, lr_0 = 9.9602e-04
Validation auc = 0.700336
Epoch 5868
Loss = 6.0345e-03, PNorm = 413.7396, GNorm = 0.5246, lr_0 = 9.9602e-04
Validation auc = 0.701538
Epoch 5869
Loss = 1.0305e-02, PNorm = 413.7569, GNorm = 1.1004, lr_0 = 9.9602e-04
Loss = 3.0494e-02, PNorm = 413.7766, GNorm = 0.1972, lr_0 = 9.9602e-04
Validation auc = 0.704112
Epoch 5870
Loss = 7.1119e-03, PNorm = 413.7967, GNorm = 0.0535, lr_0 = 9.9602e-04
Validation auc = 0.703834
Epoch 5871
Loss = 2.6975e-02, PNorm = 413.8163, GNorm = 0.0315, lr_0 = 9.9602e-04
Validation auc = 0.706805
Epoch 5872
Loss = 3.8192e-03, PNorm = 413.8346, GNorm = 0.1304, lr_0 = 9.9602e-04
Validation auc = 0.706184
Epoch 5873
Loss = 7.8338e-02, PNorm = 413.8693, GNorm = 1.0811, lr_0 = 9.9602e-04
Validation auc = 0.704092
Epoch 5874
Loss = 2.0629e-02, PNorm = 413.9152, GNorm = 0.4672, lr_0 = 9.9602e-04
Validation auc = 0.707726
Epoch 5875
Loss = 1.1605e-02, PNorm = 413.9565, GNorm = 0.2713, lr_0 = 9.9602e-04
Validation auc = 0.709465
Epoch 5876
Loss = 7.1576e-03, PNorm = 413.9878, GNorm = 0.1038, lr_0 = 9.9602e-04
Validation auc = 0.712165
Epoch 5877
Loss = 8.3512e-03, PNorm = 414.0113, GNorm = 0.6955, lr_0 = 9.9602e-04
Validation auc = 0.706603
Epoch 5878
Loss = 2.2235e-02, PNorm = 414.0324, GNorm = 0.1987, lr_0 = 9.9602e-04
Validation auc = 0.699860
Epoch 5879
Loss = 9.0957e-03, PNorm = 414.0711, GNorm = 0.2758, lr_0 = 9.9602e-04
Loss = 4.0339e-02, PNorm = 414.1111, GNorm = 0.1047, lr_0 = 9.9602e-04
Validation auc = 0.697444
Epoch 5880
Loss = 1.8370e-02, PNorm = 414.1482, GNorm = 2.9547, lr_0 = 9.9601e-04
Validation auc = 0.699888
Epoch 5881
Loss = 2.2038e-02, PNorm = 414.1876, GNorm = 1.1929, lr_0 = 9.9601e-04
Validation auc = 0.702525
Epoch 5882
Loss = 6.2268e-02, PNorm = 414.2256, GNorm = 0.9345, lr_0 = 9.9601e-04
Validation auc = 0.704388
Epoch 5883
Loss = 3.7110e-02, PNorm = 414.2699, GNorm = 1.3520, lr_0 = 9.9601e-04
Validation auc = 0.706257
Epoch 5884
Loss = 1.6673e-02, PNorm = 414.3099, GNorm = 1.4666, lr_0 = 9.9601e-04
Validation auc = 0.704928
Epoch 5885
Loss = 2.8527e-02, PNorm = 414.3462, GNorm = 0.6538, lr_0 = 9.9601e-04
Validation auc = 0.707853
Epoch 5886
Loss = 2.1782e-02, PNorm = 414.3724, GNorm = 0.0538, lr_0 = 9.9601e-04
Validation auc = 0.712668
Epoch 5887
Loss = 1.1286e-01, PNorm = 414.3945, GNorm = 0.1134, lr_0 = 9.9601e-04
Validation auc = 0.707019
Epoch 5888
Loss = 3.0260e-03, PNorm = 414.4390, GNorm = 0.0968, lr_0 = 9.9601e-04
Validation auc = 0.697009
Epoch 5889
Loss = 2.6737e-02, PNorm = 414.4923, GNorm = 0.7796, lr_0 = 9.9601e-04
Loss = 3.6905e-02, PNorm = 414.5437, GNorm = 1.0937, lr_0 = 9.9601e-04
Validation auc = 0.686397
Epoch 5890
Loss = 2.4679e-02, PNorm = 414.5890, GNorm = 1.1380, lr_0 = 9.9601e-04
Validation auc = 0.686487
Epoch 5891
Loss = 2.6085e-02, PNorm = 414.6204, GNorm = 1.9939, lr_0 = 9.9601e-04
Validation auc = 0.691287
Epoch 5892
Loss = 2.9817e-02, PNorm = 414.6482, GNorm = 1.3498, lr_0 = 9.9601e-04
Validation auc = 0.691666
Epoch 5893
Loss = 7.2438e-02, PNorm = 414.6875, GNorm = 4.0348, lr_0 = 9.9600e-04
Validation auc = 0.702158
Epoch 5894
Loss = 6.7677e-03, PNorm = 414.7423, GNorm = 0.3919, lr_0 = 9.9600e-04
Validation auc = 0.705638
Epoch 5895
Loss = 4.0522e-02, PNorm = 414.7788, GNorm = 0.0548, lr_0 = 9.9600e-04
Validation auc = 0.703524
Epoch 5896
Loss = 2.4175e-02, PNorm = 414.8164, GNorm = 1.2660, lr_0 = 9.9600e-04
Validation auc = 0.699102
Epoch 5897
Loss = 2.1003e-02, PNorm = 414.8573, GNorm = 0.0858, lr_0 = 9.9600e-04
Validation auc = 0.695887
Epoch 5898
Loss = 1.9149e-02, PNorm = 414.8956, GNorm = 0.7350, lr_0 = 9.9600e-04
Validation auc = 0.696549
Epoch 5899
Loss = 1.4429e-03, PNorm = 414.9336, GNorm = 0.0603, lr_0 = 9.9600e-04
Loss = 2.3808e-02, PNorm = 414.9729, GNorm = 1.5876, lr_0 = 9.9600e-04
Validation auc = 0.689334
Epoch 5900
Loss = 1.8568e-02, PNorm = 415.0108, GNorm = 0.1981, lr_0 = 9.9600e-04
Validation auc = 0.686271
Epoch 5901
Loss = 1.7824e-02, PNorm = 415.0424, GNorm = 0.2695, lr_0 = 9.9600e-04
Validation auc = 0.686788
Epoch 5902
Loss = 3.5505e-02, PNorm = 415.0725, GNorm = 3.2875, lr_0 = 9.9600e-04
Validation auc = 0.687209
Epoch 5903
Loss = 1.8918e-02, PNorm = 415.1043, GNorm = 0.1360, lr_0 = 9.9600e-04
Validation auc = 0.683975
Epoch 5904
Loss = 1.4490e-02, PNorm = 415.1328, GNorm = 0.1151, lr_0 = 9.9600e-04
Validation auc = 0.684728
Epoch 5905
Loss = 5.1155e-02, PNorm = 415.1665, GNorm = 1.4177, lr_0 = 9.9600e-04
Validation auc = 0.684242
Epoch 5906
Loss = 5.4992e-02, PNorm = 415.2017, GNorm = 2.5892, lr_0 = 9.9600e-04
Validation auc = 0.682095
Epoch 5907
Loss = 6.3458e-03, PNorm = 415.2438, GNorm = 0.2979, lr_0 = 9.9599e-04
Validation auc = 0.684728
Epoch 5908
Loss = 1.7772e-03, PNorm = 415.2754, GNorm = 0.0908, lr_0 = 9.9599e-04
Validation auc = 0.686632
Epoch 5909
Loss = 9.4810e-03, PNorm = 415.3027, GNorm = 0.4625, lr_0 = 9.9599e-04
Loss = 2.3826e-02, PNorm = 415.3280, GNorm = 1.4588, lr_0 = 9.9599e-04
Validation auc = 0.691492
Epoch 5910
Loss = 3.0477e-02, PNorm = 415.3583, GNorm = 0.1266, lr_0 = 9.9599e-04
Validation auc = 0.695081
Epoch 5911
Loss = 2.1665e-02, PNorm = 415.3912, GNorm = 0.1407, lr_0 = 9.9599e-04
Validation auc = 0.690901
Epoch 5912
Loss = 2.0163e-02, PNorm = 415.4230, GNorm = 3.4347, lr_0 = 9.9599e-04
Validation auc = 0.689237
Epoch 5913
Loss = 1.0607e-02, PNorm = 415.4617, GNorm = 0.9822, lr_0 = 9.9599e-04
Validation auc = 0.692813
Epoch 5914
Loss = 7.3118e-02, PNorm = 415.4960, GNorm = 0.1451, lr_0 = 9.9599e-04
Validation auc = 0.696029
Epoch 5915
Loss = 7.0964e-03, PNorm = 415.5321, GNorm = 0.2929, lr_0 = 9.9599e-04
Validation auc = 0.696628
Epoch 5916
Loss = 1.0998e-02, PNorm = 415.5562, GNorm = 0.1055, lr_0 = 9.9599e-04
Validation auc = 0.697735
Epoch 5917
Loss = 6.0624e-03, PNorm = 415.5781, GNorm = 0.1039, lr_0 = 9.9599e-04
Validation auc = 0.693602
Epoch 5918
Loss = 2.3344e-03, PNorm = 415.5986, GNorm = 0.0376, lr_0 = 9.9599e-04
Validation auc = 0.689292
Epoch 5919
Loss = 6.7578e-02, PNorm = 415.6144, GNorm = 2.8691, lr_0 = 9.9599e-04
Loss = 1.3836e-02, PNorm = 415.6362, GNorm = 0.0456, lr_0 = 9.9599e-04
Validation auc = 0.688695
Epoch 5920
Loss = 6.3062e-03, PNorm = 415.6600, GNorm = 0.1262, lr_0 = 9.9598e-04
Validation auc = 0.690189
Epoch 5921
Loss = 1.9460e-02, PNorm = 415.6772, GNorm = 0.3551, lr_0 = 9.9598e-04
Validation auc = 0.696236
Epoch 5922
Loss = 4.2231e-02, PNorm = 415.7002, GNorm = 8.0405, lr_0 = 9.9598e-04
Validation auc = 0.704318
Epoch 5923
Loss = 3.0524e-02, PNorm = 415.7569, GNorm = 0.0037, lr_0 = 9.9598e-04
Validation auc = 0.709635
Epoch 5924
Loss = 1.2100e-01, PNorm = 415.8042, GNorm = 0.0525, lr_0 = 9.9598e-04
Validation auc = 0.710882
Epoch 5925
Loss = 3.2377e-02, PNorm = 415.8494, GNorm = 0.1492, lr_0 = 9.9598e-04
Validation auc = 0.705382
Epoch 5926
Loss = 1.3538e-02, PNorm = 415.8984, GNorm = 1.1191, lr_0 = 9.9598e-04
Validation auc = 0.707638
Epoch 5927
Loss = 7.0446e-02, PNorm = 415.9358, GNorm = 0.5318, lr_0 = 9.9598e-04
Validation auc = 0.708026
Epoch 5928
Loss = 1.3149e-01, PNorm = 415.9708, GNorm = 1.1043, lr_0 = 9.9598e-04
Validation auc = 0.696974
Epoch 5929
Loss = 1.3913e-02, PNorm = 416.0126, GNorm = 1.0474, lr_0 = 9.9598e-04
Loss = 3.0697e-02, PNorm = 416.0547, GNorm = 0.4548, lr_0 = 9.9598e-04
Validation auc = 0.703113
Epoch 5930
Loss = 2.4226e-02, PNorm = 416.0999, GNorm = 0.8387, lr_0 = 9.9598e-04
Validation auc = 0.705676
Epoch 5931
Loss = 9.2968e-03, PNorm = 416.1347, GNorm = 0.4818, lr_0 = 9.9598e-04
Validation auc = 0.706871
Epoch 5932
Loss = 1.5009e-02, PNorm = 416.1632, GNorm = 0.1827, lr_0 = 9.9598e-04
Validation auc = 0.703749
Epoch 5933
Loss = 2.5712e-02, PNorm = 416.1833, GNorm = 1.1327, lr_0 = 9.9597e-04
Validation auc = 0.701243
Epoch 5934
Loss = 3.1906e-02, PNorm = 416.2252, GNorm = 0.1453, lr_0 = 9.9597e-04
Validation auc = 0.689465
Epoch 5935
Loss = 5.9240e-03, PNorm = 416.2694, GNorm = 0.1782, lr_0 = 9.9597e-04
Validation auc = 0.683656
Epoch 5936
Loss = 4.8672e-03, PNorm = 416.2985, GNorm = 0.8481, lr_0 = 9.9597e-04
Validation auc = 0.685133
Epoch 5937
Loss = 2.7857e-02, PNorm = 416.3135, GNorm = 0.1640, lr_0 = 9.9597e-04
Validation auc = 0.687433
Epoch 5938
Loss = 7.0608e-03, PNorm = 416.3417, GNorm = 0.1232, lr_0 = 9.9597e-04
Validation auc = 0.692114
Epoch 5939
Loss = 9.0548e-02, PNorm = 416.3725, GNorm = 1.7333, lr_0 = 9.9597e-04
Loss = 4.4279e-02, PNorm = 416.4107, GNorm = 0.5490, lr_0 = 9.9597e-04
Validation auc = 0.701408
Epoch 5940
Loss = 1.6925e-02, PNorm = 416.4513, GNorm = 1.0167, lr_0 = 9.9597e-04
Validation auc = 0.701975
Epoch 5941
Loss = 6.7016e-02, PNorm = 416.4802, GNorm = 2.0092, lr_0 = 9.9597e-04
Validation auc = 0.702477
Epoch 5942
Loss = 2.2997e-02, PNorm = 416.5185, GNorm = 0.7755, lr_0 = 9.9597e-04
Validation auc = 0.699467
Epoch 5943
Loss = 2.5300e-02, PNorm = 416.5545, GNorm = 0.9706, lr_0 = 9.9597e-04
Validation auc = 0.693933
Epoch 5944
Loss = 3.1588e-02, PNorm = 416.5886, GNorm = 0.5182, lr_0 = 9.9597e-04
Validation auc = 0.691278
Epoch 5945
Loss = 1.5195e-02, PNorm = 416.6266, GNorm = 0.0978, lr_0 = 9.9597e-04
Validation auc = 0.692587
Epoch 5946
Loss = 1.2300e-02, PNorm = 416.6548, GNorm = 0.9721, lr_0 = 9.9597e-04
Validation auc = 0.693096
Epoch 5947
Loss = 2.6404e-02, PNorm = 416.6761, GNorm = 0.1010, lr_0 = 9.9596e-04
Validation auc = 0.694967
Epoch 5948
Loss = 2.2204e-02, PNorm = 416.7002, GNorm = 0.2454, lr_0 = 9.9596e-04
Validation auc = 0.696321
Epoch 5949
Loss = 5.5603e-03, PNorm = 416.7278, GNorm = 0.2041, lr_0 = 9.9596e-04
Loss = 2.6053e-02, PNorm = 416.7578, GNorm = 0.1748, lr_0 = 9.9596e-04
Validation auc = 0.698875
Epoch 5950
Loss = 2.1129e-02, PNorm = 416.7855, GNorm = 0.0708, lr_0 = 9.9596e-04
Validation auc = 0.694479
Epoch 5951
Loss = 1.9367e-02, PNorm = 416.8141, GNorm = 0.0393, lr_0 = 9.9596e-04
Validation auc = 0.685243
Epoch 5952
Loss = 1.5111e-02, PNorm = 416.8372, GNorm = 0.0530, lr_0 = 9.9596e-04
Validation auc = 0.682961
Epoch 5953
Loss = 4.4936e-02, PNorm = 416.8629, GNorm = 0.4923, lr_0 = 9.9596e-04
Validation auc = 0.687038
Epoch 5954
Loss = 2.0408e-02, PNorm = 416.8913, GNorm = 1.9778, lr_0 = 9.9596e-04
Validation auc = 0.681936
Epoch 5955
Loss = 4.2982e-02, PNorm = 416.9181, GNorm = 3.4589, lr_0 = 9.9596e-04
Validation auc = 0.678864
Epoch 5956
Loss = 4.5468e-03, PNorm = 416.9427, GNorm = 0.1694, lr_0 = 9.9596e-04
Validation auc = 0.685658
Epoch 5957
Loss = 1.1220e-02, PNorm = 416.9671, GNorm = 0.6649, lr_0 = 9.9596e-04
Validation auc = 0.692284
Epoch 5958
Loss = 3.8875e-03, PNorm = 416.9920, GNorm = 0.2337, lr_0 = 9.9596e-04
Validation auc = 0.696580
Epoch 5959
Loss = 3.2274e-03, PNorm = 417.0140, GNorm = 0.1516, lr_0 = 9.9596e-04
Loss = 1.3392e-02, PNorm = 417.0419, GNorm = 0.4722, lr_0 = 9.9595e-04
Validation auc = 0.695746
Epoch 5960
Loss = 1.6150e-02, PNorm = 417.0676, GNorm = 0.0433, lr_0 = 9.9595e-04
Validation auc = 0.694459
Epoch 5961
Loss = 8.5863e-03, PNorm = 417.0886, GNorm = 0.3309, lr_0 = 9.9595e-04
Validation auc = 0.698954
Epoch 5962
Loss = 4.9189e-03, PNorm = 417.1271, GNorm = 0.9235, lr_0 = 9.9595e-04
Validation auc = 0.700145
Epoch 5963
Loss = 1.7119e-02, PNorm = 417.1660, GNorm = 0.0698, lr_0 = 9.9595e-04
Validation auc = 0.702195
Epoch 5964
Loss = 1.7654e-02, PNorm = 417.1963, GNorm = 0.0345, lr_0 = 9.9595e-04
Validation auc = 0.707214
Epoch 5965
Loss = 2.8100e-02, PNorm = 417.2312, GNorm = 0.2467, lr_0 = 9.9595e-04
Validation auc = 0.708220
Epoch 5966
Loss = 3.7051e-02, PNorm = 417.2611, GNorm = 0.0278, lr_0 = 9.9595e-04
Validation auc = 0.706913
Epoch 5967
Loss = 2.2047e-03, PNorm = 417.2879, GNorm = 0.2252, lr_0 = 9.9595e-04
Validation auc = 0.711413
Epoch 5968
Loss = 7.1602e-02, PNorm = 417.3107, GNorm = 3.3348, lr_0 = 9.9595e-04
Validation auc = 0.696004
Epoch 5969
Loss = 1.8965e-02, PNorm = 417.3392, GNorm = 0.7307, lr_0 = 9.9595e-04
Loss = 5.0590e-02, PNorm = 417.3834, GNorm = 2.3233, lr_0 = 9.9595e-04
Validation auc = 0.695821
Epoch 5970
Loss = 2.0365e-02, PNorm = 417.4253, GNorm = 1.9242, lr_0 = 9.9595e-04
Validation auc = 0.695048
Epoch 5971
Loss = 4.4040e-02, PNorm = 417.4620, GNorm = 0.2167, lr_0 = 9.9595e-04
Validation auc = 0.687443
Epoch 5972
Loss = 2.9046e-02, PNorm = 417.4988, GNorm = 0.1919, lr_0 = 9.9595e-04
Validation auc = 0.685900
Epoch 5973
Loss = 2.3332e-02, PNorm = 417.5310, GNorm = 0.0785, lr_0 = 9.9594e-04
Validation auc = 0.689611
Epoch 5974
Loss = 7.9814e-02, PNorm = 417.5624, GNorm = 1.2656, lr_0 = 9.9594e-04
Validation auc = 0.691606
Epoch 5975
Loss = 2.9936e-02, PNorm = 417.6021, GNorm = 0.3081, lr_0 = 9.9594e-04
Validation auc = 0.687170
Epoch 5976
Loss = 6.6754e-02, PNorm = 417.6419, GNorm = 0.5835, lr_0 = 9.9594e-04
Validation auc = 0.689841
Epoch 5977
Loss = 2.7283e-02, PNorm = 417.6913, GNorm = 1.4496, lr_0 = 9.9594e-04
Validation auc = 0.699786
Epoch 5978
Loss = 5.6584e-03, PNorm = 417.7301, GNorm = 0.1994, lr_0 = 9.9594e-04
Validation auc = 0.701606
Epoch 5979
Loss = 6.6641e-02, PNorm = 417.7556, GNorm = 2.7157, lr_0 = 9.9594e-04
Loss = 2.3489e-02, PNorm = 417.7843, GNorm = 0.1475, lr_0 = 9.9594e-04
Validation auc = 0.704439
Epoch 5980
Loss = 1.5034e-02, PNorm = 417.8110, GNorm = 0.5891, lr_0 = 9.9594e-04
Validation auc = 0.702202
Epoch 5981
Loss = 9.8475e-03, PNorm = 417.8353, GNorm = 0.0452, lr_0 = 9.9594e-04
Validation auc = 0.703143
Epoch 5982
Loss = 5.4213e-02, PNorm = 417.8581, GNorm = 0.0745, lr_0 = 9.9594e-04
Validation auc = 0.691008
Epoch 5983
Loss = 4.8244e-02, PNorm = 417.8886, GNorm = 0.2069, lr_0 = 9.9594e-04
Validation auc = 0.675513
Epoch 5984
Loss = 3.0458e-02, PNorm = 417.9228, GNorm = 0.3090, lr_0 = 9.9594e-04
Validation auc = 0.674901
Epoch 5985
Loss = 3.3772e-02, PNorm = 417.9517, GNorm = 1.2307, lr_0 = 9.9594e-04
Validation auc = 0.680186
Epoch 5986
Loss = 7.7914e-02, PNorm = 417.9890, GNorm = 2.3175, lr_0 = 9.9594e-04
Validation auc = 0.673095
Epoch 5987
Loss = 1.3390e-02, PNorm = 418.0263, GNorm = 0.3173, lr_0 = 9.9593e-04
Validation auc = 0.674952
Epoch 5988
Loss = 5.0989e-02, PNorm = 418.0585, GNorm = 0.2680, lr_0 = 9.9593e-04
Validation auc = 0.678674
Epoch 5989
Loss = 2.4665e-03, PNorm = 418.0844, GNorm = 0.1121, lr_0 = 9.9593e-04
Loss = 1.3015e-02, PNorm = 418.1030, GNorm = 0.1242, lr_0 = 9.9593e-04
Validation auc = 0.681853
Epoch 5990
Loss = 1.6135e-02, PNorm = 418.1168, GNorm = 1.1101, lr_0 = 9.9593e-04
Validation auc = 0.685945
Epoch 5991
Loss = 9.2268e-03, PNorm = 418.1338, GNorm = 0.0465, lr_0 = 9.9593e-04
Validation auc = 0.688306
Epoch 5992
Loss = 3.1043e-02, PNorm = 418.1553, GNorm = 1.0691, lr_0 = 9.9593e-04
Validation auc = 0.690869
Epoch 5993
Loss = 8.9224e-03, PNorm = 418.1890, GNorm = 0.4097, lr_0 = 9.9593e-04
Validation auc = 0.691814
Epoch 5994
Loss = 1.5151e-02, PNorm = 418.2206, GNorm = 3.4117, lr_0 = 9.9593e-04
Validation auc = 0.694011
Epoch 5995
Loss = 5.3456e-03, PNorm = 418.2483, GNorm = 0.0478, lr_0 = 9.9593e-04
Validation auc = 0.694699
Epoch 5996
Loss = 6.6198e-02, PNorm = 418.2754, GNorm = 2.5643, lr_0 = 9.9593e-04
Validation auc = 0.690734
Epoch 5997
Loss = 1.1227e-02, PNorm = 418.3063, GNorm = 0.0447, lr_0 = 9.9593e-04
Validation auc = 0.686116
Epoch 5998
Loss = 2.5868e-03, PNorm = 418.3368, GNorm = 0.1433, lr_0 = 9.9593e-04
Validation auc = 0.683749
Epoch 5999
Loss = 5.2148e-03, PNorm = 418.3587, GNorm = 0.5544, lr_0 = 9.9593e-04
Loss = 2.7943e-02, PNorm = 418.3854, GNorm = 2.3656, lr_0 = 9.9592e-04
Validation auc = 0.684712
Epoch 6000
Loss = 1.5132e-02, PNorm = 418.4213, GNorm = 0.9996, lr_0 = 9.9592e-04
Validation auc = 0.686513
Epoch 6001
Loss = 2.6057e-02, PNorm = 418.4597, GNorm = 0.1269, lr_0 = 9.9592e-04
Validation auc = 0.688966
Epoch 6002
Loss = 4.1909e-02, PNorm = 418.5141, GNorm = 2.4718, lr_0 = 9.9592e-04
Validation auc = 0.684938
Epoch 6003
Loss = 4.9671e-02, PNorm = 418.5768, GNorm = 1.5311, lr_0 = 9.9592e-04
Validation auc = 0.681343
Epoch 6004
Loss = 2.8047e-02, PNorm = 418.6210, GNorm = 0.0907, lr_0 = 9.9592e-04
Validation auc = 0.682102
Epoch 6005
Loss = 3.1261e-02, PNorm = 418.6650, GNorm = 0.6552, lr_0 = 9.9592e-04
Validation auc = 0.683227
Epoch 6006
Loss = 1.7804e-02, PNorm = 418.7226, GNorm = 0.0583, lr_0 = 9.9592e-04
Validation auc = 0.679080
Epoch 6007
Loss = 2.1712e-02, PNorm = 418.7769, GNorm = 0.6423, lr_0 = 9.9592e-04
Validation auc = 0.683626
Epoch 6008
Loss = 2.9142e-03, PNorm = 418.8144, GNorm = 0.1669, lr_0 = 9.9592e-04
Validation auc = 0.684356
Epoch 6009
Loss = 2.3418e-03, PNorm = 418.8406, GNorm = 0.1304, lr_0 = 9.9592e-04
Loss = 2.1822e-02, PNorm = 418.8635, GNorm = 0.0872, lr_0 = 9.9592e-04
Validation auc = 0.677728
Epoch 6010
Loss = 5.3630e-02, PNorm = 418.8917, GNorm = 0.1064, lr_0 = 9.9592e-04
Validation auc = 0.681605
Epoch 6011
Loss = 2.5405e-02, PNorm = 418.9240, GNorm = 0.5822, lr_0 = 9.9592e-04
Validation auc = 0.676819
Epoch 6012
Loss = 1.8588e-02, PNorm = 418.9592, GNorm = 1.6797, lr_0 = 9.9592e-04
Validation auc = 0.682673
Epoch 6013
Loss = 4.0260e-02, PNorm = 418.9943, GNorm = 2.8600, lr_0 = 9.9591e-04
Validation auc = 0.680264
Epoch 6014
Loss = 5.6682e-03, PNorm = 419.0356, GNorm = 0.0989, lr_0 = 9.9591e-04
Validation auc = 0.673108
Epoch 6015
Loss = 1.1012e-02, PNorm = 419.0644, GNorm = 1.3410, lr_0 = 9.9591e-04
Validation auc = 0.672210
Epoch 6016
Loss = 1.9312e-02, PNorm = 419.0997, GNorm = 0.6578, lr_0 = 9.9591e-04
Validation auc = 0.674326
Epoch 6017
Loss = 6.7502e-02, PNorm = 419.1282, GNorm = 0.9183, lr_0 = 9.9591e-04
Validation auc = 0.672071
Epoch 6018
Loss = 5.6723e-02, PNorm = 419.1668, GNorm = 1.5944, lr_0 = 9.9591e-04
Validation auc = 0.672427
Epoch 6019
Loss = 2.4794e-01, PNorm = 419.2082, GNorm = 6.4234, lr_0 = 9.9591e-04
Loss = 7.7156e-03, PNorm = 419.2547, GNorm = 0.1716, lr_0 = 9.9591e-04
Validation auc = 0.673264
Epoch 6020
Loss = 4.2192e-02, PNorm = 419.2882, GNorm = 0.0740, lr_0 = 9.9591e-04
Validation auc = 0.667610
Epoch 6021
Loss = 3.0843e-02, PNorm = 419.3201, GNorm = 2.4585, lr_0 = 9.9591e-04
Validation auc = 0.664839
Epoch 6022
Loss = 1.8378e-02, PNorm = 419.3475, GNorm = 0.4402, lr_0 = 9.9591e-04
Validation auc = 0.666960
Epoch 6023
Loss = 2.3080e-02, PNorm = 419.3809, GNorm = 1.4520, lr_0 = 9.9591e-04
Validation auc = 0.666093
Epoch 6024
Loss = 2.4198e-02, PNorm = 419.4143, GNorm = 0.1946, lr_0 = 9.9591e-04
Validation auc = 0.667645
Epoch 6025
Loss = 1.2675e-02, PNorm = 419.4461, GNorm = 0.2634, lr_0 = 9.9591e-04
Validation auc = 0.669599
Epoch 6026
Loss = 3.9732e-02, PNorm = 419.4707, GNorm = 1.4896, lr_0 = 9.9590e-04
Validation auc = 0.665764
Epoch 6027
Loss = 4.5690e-02, PNorm = 419.4986, GNorm = 1.0210, lr_0 = 9.9590e-04
Validation auc = 0.665965
Epoch 6028
Loss = 2.0911e-01, PNorm = 419.5462, GNorm = 0.4634, lr_0 = 9.9590e-04
Validation auc = 0.676768
Epoch 6029
Loss = 1.9884e-03, PNorm = 419.6035, GNorm = 0.0764, lr_0 = 9.9590e-04
Loss = 3.7957e-02, PNorm = 419.6463, GNorm = 4.7378, lr_0 = 9.9590e-04
Validation auc = 0.682370
Epoch 6030
Loss = 4.2852e-02, PNorm = 419.6840, GNorm = 2.4320, lr_0 = 9.9590e-04
Validation auc = 0.679278
Epoch 6031
Loss = 1.4963e-02, PNorm = 419.7238, GNorm = 0.1018, lr_0 = 9.9590e-04
Validation auc = 0.674396
Epoch 6032
Loss = 2.1187e-02, PNorm = 419.7556, GNorm = 0.2153, lr_0 = 9.9590e-04
Validation auc = 0.672322
Epoch 6033
Loss = 3.4235e-02, PNorm = 419.7825, GNorm = 1.6736, lr_0 = 9.9590e-04
Validation auc = 0.677784
Epoch 6034
Loss = 1.3880e-02, PNorm = 419.8224, GNorm = 0.8643, lr_0 = 9.9590e-04
Validation auc = 0.676677
Epoch 6035
Loss = 2.0630e-02, PNorm = 419.8584, GNorm = 0.3582, lr_0 = 9.9590e-04
Validation auc = 0.676300
Epoch 6036
Loss = 4.8740e-02, PNorm = 419.8891, GNorm = 1.2387, lr_0 = 9.9590e-04
Validation auc = 0.680377
Epoch 6037
Loss = 1.3033e-02, PNorm = 419.9294, GNorm = 0.0222, lr_0 = 9.9590e-04
Validation auc = 0.680463
Epoch 6038
Loss = 2.3766e-03, PNorm = 419.9700, GNorm = 0.1499, lr_0 = 9.9590e-04
Validation auc = 0.676946
Epoch 6039
Loss = 4.8229e-04, PNorm = 420.0009, GNorm = 0.0428, lr_0 = 9.9590e-04
Loss = 3.0476e-02, PNorm = 420.0378, GNorm = 1.8802, lr_0 = 9.9589e-04
Validation auc = 0.673831
Epoch 6040
Loss = 5.3269e-02, PNorm = 420.0773, GNorm = 0.2366, lr_0 = 9.9589e-04
Validation auc = 0.674380
Epoch 6041
Loss = 1.6921e-02, PNorm = 420.1118, GNorm = 1.5636, lr_0 = 9.9589e-04
Validation auc = 0.674298
Epoch 6042
Loss = 1.5744e-02, PNorm = 420.1393, GNorm = 0.1978, lr_0 = 9.9589e-04
Validation auc = 0.676637
Epoch 6043
Loss = 3.3562e-02, PNorm = 420.1644, GNorm = 1.5038, lr_0 = 9.9589e-04
Validation auc = 0.674735
Epoch 6044
Loss = 2.8384e-02, PNorm = 420.1875, GNorm = 0.2413, lr_0 = 9.9589e-04
Validation auc = 0.674975
Epoch 6045
Loss = 6.9558e-02, PNorm = 420.2090, GNorm = 0.0520, lr_0 = 9.9589e-04
Validation auc = 0.679230
Epoch 6046
Loss = 1.0408e-02, PNorm = 420.2417, GNorm = 0.4127, lr_0 = 9.9589e-04
Validation auc = 0.681531
Epoch 6047
Loss = 6.0212e-03, PNorm = 420.2826, GNorm = 0.0972, lr_0 = 9.9589e-04
Validation auc = 0.685223
Epoch 6048
Loss = 2.9246e-03, PNorm = 420.3125, GNorm = 0.1377, lr_0 = 9.9589e-04
Validation auc = 0.686619
Epoch 6049
Loss = 9.2311e-02, PNorm = 420.3326, GNorm = 2.8628, lr_0 = 9.9589e-04
Loss = 2.5726e-02, PNorm = 420.3590, GNorm = 2.1220, lr_0 = 9.9589e-04
Validation auc = 0.683274
Epoch 6050
Loss = 1.8288e-02, PNorm = 420.4001, GNorm = 0.0463, lr_0 = 9.9589e-04
Validation auc = 0.683015
Epoch 6051
Loss = 2.2717e-02, PNorm = 420.4411, GNorm = 0.2962, lr_0 = 9.9589e-04
Validation auc = 0.680953
Epoch 6052
Loss = 1.0362e-02, PNorm = 420.4749, GNorm = 0.3674, lr_0 = 9.9588e-04
Validation auc = 0.678377
Epoch 6053
Loss = 1.2428e-02, PNorm = 420.4981, GNorm = 2.5015, lr_0 = 9.9588e-04
Validation auc = 0.671949
Epoch 6054
Loss = 3.5590e-02, PNorm = 420.5224, GNorm = 0.0523, lr_0 = 9.9588e-04
Validation auc = 0.664966
Epoch 6055
Loss = 4.5205e-02, PNorm = 420.5513, GNorm = 3.5732, lr_0 = 9.9588e-04
Validation auc = 0.663341
Epoch 6056
Loss = 5.4486e-02, PNorm = 420.5991, GNorm = 1.3057, lr_0 = 9.9588e-04
Validation auc = 0.665937
Epoch 6057
Loss = 5.0912e-03, PNorm = 420.6464, GNorm = 0.2418, lr_0 = 9.9588e-04
Validation auc = 0.674173
Epoch 6058
Loss = 2.2203e-03, PNorm = 420.6884, GNorm = 0.0316, lr_0 = 9.9588e-04
Validation auc = 0.676327
Epoch 6059
Loss = 1.0094e-01, PNorm = 420.7260, GNorm = 1.5818, lr_0 = 9.9588e-04
Loss = 1.3597e-02, PNorm = 420.7660, GNorm = 0.1495, lr_0 = 9.9588e-04
Validation auc = 0.678204
Epoch 6060
Loss = 9.9247e-03, PNorm = 420.7934, GNorm = 0.0807, lr_0 = 9.9588e-04
Validation auc = 0.683744
Epoch 6061
Loss = 3.4011e-02, PNorm = 420.8138, GNorm = 0.0781, lr_0 = 9.9588e-04
Validation auc = 0.687137
Epoch 6062
Loss = 5.2667e-02, PNorm = 420.8395, GNorm = 3.4228, lr_0 = 9.9588e-04
Validation auc = 0.678530
Epoch 6063
Loss = 2.8875e-02, PNorm = 420.8813, GNorm = 0.2289, lr_0 = 9.9588e-04
Validation auc = 0.677447
Epoch 6064
Loss = 1.6513e-02, PNorm = 420.9330, GNorm = 0.0331, lr_0 = 9.9588e-04
Validation auc = 0.686766
Epoch 6065
Loss = 1.7168e-02, PNorm = 420.9764, GNorm = 0.0059, lr_0 = 9.9588e-04
Validation auc = 0.684050
Epoch 6066
Loss = 4.9554e-03, PNorm = 421.0184, GNorm = 1.1999, lr_0 = 9.9587e-04
Validation auc = 0.678823
Epoch 6067
Loss = 5.7392e-04, PNorm = 421.0494, GNorm = 0.0716, lr_0 = 9.9587e-04
Validation auc = 0.678494
Epoch 6068
Loss = 9.8524e-03, PNorm = 421.0943, GNorm = 1.2752, lr_0 = 9.9587e-04
Validation auc = 0.686798
Epoch 6069
Loss = 8.1956e-03, PNorm = 421.1455, GNorm = 0.2119, lr_0 = 9.9587e-04
Loss = 2.4166e-02, PNorm = 421.1925, GNorm = 0.8208, lr_0 = 9.9587e-04
Validation auc = 0.685677
Epoch 6070
Loss = 3.4917e-02, PNorm = 421.2335, GNorm = 1.1930, lr_0 = 9.9587e-04
Validation auc = 0.691455
Epoch 6071
Loss = 4.3758e-02, PNorm = 421.2736, GNorm = 2.1912, lr_0 = 9.9587e-04
Validation auc = 0.695322
Epoch 6072
Loss = 2.7347e-02, PNorm = 421.3108, GNorm = 0.1881, lr_0 = 9.9587e-04
Validation auc = 0.694545
Epoch 6073
Loss = 1.8001e-02, PNorm = 421.3451, GNorm = 0.1201, lr_0 = 9.9587e-04
Validation auc = 0.691989
Epoch 6074
Loss = 2.2565e-02, PNorm = 421.3781, GNorm = 0.8879, lr_0 = 9.9587e-04
Validation auc = 0.689839
Epoch 6075
Loss = 5.7359e-03, PNorm = 421.4110, GNorm = 0.6789, lr_0 = 9.9587e-04
Validation auc = 0.687252
Epoch 6076
Loss = 1.0330e-01, PNorm = 421.4368, GNorm = 4.2644, lr_0 = 9.9587e-04
Validation auc = 0.692256
Epoch 6077
Loss = 1.8001e-02, PNorm = 421.4767, GNorm = 0.0415, lr_0 = 9.9587e-04
Validation auc = 0.687755
Epoch 6078
Loss = 3.6677e-02, PNorm = 421.5141, GNorm = 2.6970, lr_0 = 9.9587e-04
Validation auc = 0.687117
Epoch 6079
Loss = 2.4105e-02, PNorm = 421.5622, GNorm = 0.8756, lr_0 = 9.9587e-04
Loss = 3.1734e-02, PNorm = 421.6038, GNorm = 1.0375, lr_0 = 9.9586e-04
Validation auc = 0.681290
Epoch 6080
Loss = 3.3721e-02, PNorm = 421.6445, GNorm = 0.8592, lr_0 = 9.9586e-04
Validation auc = 0.683129
Epoch 6081
Loss = 9.0300e-03, PNorm = 421.6838, GNorm = 0.5787, lr_0 = 9.9586e-04
Validation auc = 0.690516
Epoch 6082
Loss = 4.0414e-02, PNorm = 421.7062, GNorm = 0.0743, lr_0 = 9.9586e-04
Validation auc = 0.695042
Epoch 6083
Loss = 1.2805e-02, PNorm = 421.7295, GNorm = 0.0755, lr_0 = 9.9586e-04
Validation auc = 0.698806
Epoch 6084
Loss = 1.3097e-02, PNorm = 421.7585, GNorm = 0.0241, lr_0 = 9.9586e-04
Validation auc = 0.697547
Epoch 6085
Loss = 1.6390e-02, PNorm = 421.7885, GNorm = 0.0148, lr_0 = 9.9586e-04
Validation auc = 0.699518
Epoch 6086
Loss = 4.9334e-03, PNorm = 421.8153, GNorm = 0.1037, lr_0 = 9.9586e-04
Validation auc = 0.703170
Epoch 6087
Loss = 4.8754e-03, PNorm = 421.8538, GNorm = 0.1330, lr_0 = 9.9586e-04
Validation auc = 0.705877
Epoch 6088
Loss = 2.3884e-02, PNorm = 421.8938, GNorm = 1.9717, lr_0 = 9.9586e-04
Validation auc = 0.701509
Epoch 6089
Loss = 5.6162e-03, PNorm = 421.9445, GNorm = 0.1996, lr_0 = 9.9586e-04
Loss = 3.6354e-02, PNorm = 421.9970, GNorm = 1.3530, lr_0 = 9.9586e-04
Validation auc = 0.706017
Epoch 6090
Loss = 4.3373e-02, PNorm = 422.0457, GNorm = 2.9649, lr_0 = 9.9586e-04
Validation auc = 0.706412
Epoch 6091
Loss = 1.7314e-02, PNorm = 422.0905, GNorm = 1.3446, lr_0 = 9.9586e-04
Validation auc = 0.705684
Epoch 6092
Loss = 8.9444e-02, PNorm = 422.1316, GNorm = 0.8087, lr_0 = 9.9585e-04
Validation auc = 0.703046
Epoch 6093
Loss = 5.3099e-02, PNorm = 422.1851, GNorm = 1.1964, lr_0 = 9.9585e-04
Validation auc = 0.699048
Epoch 6094
Loss = 4.8933e-02, PNorm = 422.2484, GNorm = 0.0788, lr_0 = 9.9585e-04
Validation auc = 0.703321
Epoch 6095
Loss = 1.7469e-02, PNorm = 422.3037, GNorm = 1.4743, lr_0 = 9.9585e-04
Validation auc = 0.700449
Epoch 6096
Loss = 3.2057e-02, PNorm = 422.3467, GNorm = 0.0705, lr_0 = 9.9585e-04
Validation auc = 0.708949
Epoch 6097
Loss = 3.7371e-03, PNorm = 422.3978, GNorm = 0.1903, lr_0 = 9.9585e-04
Validation auc = 0.712036
Epoch 6098
Loss = 2.9159e-02, PNorm = 422.4386, GNorm = 0.6828, lr_0 = 9.9585e-04
Validation auc = 0.714905
Epoch 6099
Loss = 6.0578e-03, PNorm = 422.4768, GNorm = 0.2293, lr_0 = 9.9585e-04
Loss = 2.3413e-02, PNorm = 422.5131, GNorm = 0.4639, lr_0 = 9.9585e-04
Validation auc = 0.712328
Epoch 6100
Loss = 2.3461e-02, PNorm = 422.5502, GNorm = 0.8097, lr_0 = 9.9585e-04
Validation auc = 0.711040
Epoch 6101
Loss = 8.0485e-03, PNorm = 422.5804, GNorm = 0.4305, lr_0 = 9.9585e-04
Validation auc = 0.709865
Epoch 6102
Loss = 1.6517e-02, PNorm = 422.6027, GNorm = 0.6479, lr_0 = 9.9585e-04
Validation auc = 0.709244
Epoch 6103
Loss = 3.0198e-02, PNorm = 422.6263, GNorm = 0.8958, lr_0 = 9.9585e-04
Validation auc = 0.711389
Epoch 6104
Loss = 4.4850e-02, PNorm = 422.6567, GNorm = 0.2692, lr_0 = 9.9585e-04
Validation auc = 0.716294
Epoch 6105
Loss = 1.9165e-02, PNorm = 422.6830, GNorm = 0.1390, lr_0 = 9.9585e-04
Validation auc = 0.713764
Epoch 6106
Loss = 6.8988e-03, PNorm = 422.7027, GNorm = 0.4886, lr_0 = 9.9584e-04
Validation auc = 0.710272
Epoch 6107
Loss = 1.7297e-02, PNorm = 422.7185, GNorm = 0.9486, lr_0 = 9.9584e-04
Validation auc = 0.710514
Epoch 6108
Loss = 2.4960e-03, PNorm = 422.7518, GNorm = 0.0193, lr_0 = 9.9584e-04
Validation auc = 0.712440
Epoch 6109
Loss = 5.9852e-03, PNorm = 422.7797, GNorm = 0.4547, lr_0 = 9.9584e-04
Loss = 2.7621e-02, PNorm = 422.8020, GNorm = 0.2902, lr_0 = 9.9584e-04
Validation auc = 0.711088
Epoch 6110
Loss = 4.6104e-02, PNorm = 422.8351, GNorm = 0.0172, lr_0 = 9.9584e-04
Validation auc = 0.706181
Epoch 6111
Loss = 5.8310e-02, PNorm = 422.8634, GNorm = 5.3063, lr_0 = 9.9584e-04
Validation auc = 0.704299
Epoch 6112
Loss = 2.7390e-02, PNorm = 422.8931, GNorm = 1.7809, lr_0 = 9.9584e-04
Validation auc = 0.707244
Epoch 6113
Loss = 1.6704e-02, PNorm = 422.9278, GNorm = 0.0990, lr_0 = 9.9584e-04
Validation auc = 0.706306
Epoch 6114
Loss = 7.0796e-03, PNorm = 422.9628, GNorm = 0.5977, lr_0 = 9.9584e-04
Validation auc = 0.704832
Epoch 6115
Loss = 1.1527e-02, PNorm = 422.9919, GNorm = 0.0305, lr_0 = 9.9584e-04
Validation auc = 0.713833
Epoch 6116
Loss = 1.9421e-02, PNorm = 423.0234, GNorm = 0.1320, lr_0 = 9.9584e-04
Validation auc = 0.712816
Epoch 6117
Loss = 3.5401e-02, PNorm = 423.0575, GNorm = 2.2922, lr_0 = 9.9584e-04
Validation auc = 0.709265
Epoch 6118
Loss = 1.5530e-02, PNorm = 423.0915, GNorm = 0.5425, lr_0 = 9.9584e-04
Validation auc = 0.709269
Epoch 6119
Loss = 3.2863e-03, PNorm = 423.1185, GNorm = 0.1733, lr_0 = 9.9583e-04
Loss = 4.8098e-02, PNorm = 423.1491, GNorm = 1.7031, lr_0 = 9.9583e-04
Validation auc = 0.710943
Epoch 6120
Loss = 1.4801e-02, PNorm = 423.1915, GNorm = 0.1029, lr_0 = 9.9583e-04
Validation auc = 0.711574
Epoch 6121
Loss = 7.3027e-02, PNorm = 423.2283, GNorm = 1.5418, lr_0 = 9.9583e-04
Validation auc = 0.719360
Epoch 6122
Loss = 3.6045e-02, PNorm = 423.2727, GNorm = 0.2190, lr_0 = 9.9583e-04
Validation auc = 0.721164
Epoch 6123
Loss = 1.9666e-02, PNorm = 423.3102, GNorm = 0.5101, lr_0 = 9.9583e-04
Validation auc = 0.719671
Epoch 6124
Loss = 1.4717e-02, PNorm = 423.3441, GNorm = 1.4141, lr_0 = 9.9583e-04
Validation auc = 0.715810
Epoch 6125
Loss = 6.7026e-02, PNorm = 423.3793, GNorm = 5.2607, lr_0 = 9.9583e-04
Validation auc = 0.720356
Epoch 6126
Loss = 8.1765e-03, PNorm = 423.4147, GNorm = 0.2787, lr_0 = 9.9583e-04
Validation auc = 0.719114
Epoch 6127
Loss = 2.5143e-02, PNorm = 423.4400, GNorm = 0.2068, lr_0 = 9.9583e-04
Validation auc = 0.712225
Epoch 6128
Loss = 6.7487e-03, PNorm = 423.4633, GNorm = 0.6684, lr_0 = 9.9583e-04
Validation auc = 0.714839
Epoch 6129
Loss = 1.4684e-03, PNorm = 423.5044, GNorm = 0.0632, lr_0 = 9.9583e-04
Loss = 5.3118e-02, PNorm = 423.5487, GNorm = 0.0762, lr_0 = 9.9583e-04
Validation auc = 0.708895
Epoch 6130
Loss = 3.0476e-02, PNorm = 423.5854, GNorm = 1.3408, lr_0 = 9.9583e-04
Validation auc = 0.704872
Epoch 6131
Loss = 2.3477e-02, PNorm = 423.6230, GNorm = 0.0634, lr_0 = 9.9583e-04
Validation auc = 0.705150
Epoch 6132
Loss = 3.8458e-02, PNorm = 423.6574, GNorm = 0.5144, lr_0 = 9.9582e-04
Validation auc = 0.711445
Epoch 6133
Loss = 2.6860e-02, PNorm = 423.6841, GNorm = 1.6039, lr_0 = 9.9582e-04
Validation auc = 0.713454
Epoch 6134
Loss = 1.6678e-02, PNorm = 423.7052, GNorm = 2.1905, lr_0 = 9.9582e-04
Validation auc = 0.719229
Epoch 6135
Loss = 4.6374e-02, PNorm = 423.7311, GNorm = 4.8229, lr_0 = 9.9582e-04
Validation auc = 0.723295
Epoch 6136
Loss = 8.7868e-03, PNorm = 423.7672, GNorm = 0.0808, lr_0 = 9.9582e-04
Validation auc = 0.724917
Epoch 6137
Loss = 3.7797e-02, PNorm = 423.8007, GNorm = 1.7228, lr_0 = 9.9582e-04
Validation auc = 0.727234
Epoch 6138
Loss = 2.3506e-03, PNorm = 423.8271, GNorm = 0.0619, lr_0 = 9.9582e-04
Validation auc = 0.724428
Epoch 6139
Loss = 2.3302e-03, PNorm = 423.8489, GNorm = 0.0752, lr_0 = 9.9582e-04
Loss = 4.0503e-02, PNorm = 423.8689, GNorm = 0.9739, lr_0 = 9.9582e-04
Validation auc = 0.724946
Epoch 6140
Loss = 1.2127e-02, PNorm = 423.8962, GNorm = 0.4058, lr_0 = 9.9582e-04
Validation auc = 0.720939
Epoch 6141
Loss = 1.6678e-02, PNorm = 423.9246, GNorm = 0.0878, lr_0 = 9.9582e-04
Validation auc = 0.720991
Epoch 6142
Loss = 2.4577e-02, PNorm = 423.9516, GNorm = 0.1174, lr_0 = 9.9582e-04
Validation auc = 0.723322
Epoch 6143
Loss = 4.5328e-02, PNorm = 423.9794, GNorm = 3.1223, lr_0 = 9.9582e-04
Validation auc = 0.722462
Epoch 6144
Loss = 2.6679e-02, PNorm = 424.0085, GNorm = 0.0085, lr_0 = 9.9582e-04
Validation auc = 0.720973
Epoch 6145
Loss = 3.1184e-02, PNorm = 424.0425, GNorm = 0.6377, lr_0 = 9.9582e-04
Validation auc = 0.721125
Epoch 6146
Loss = 7.6125e-02, PNorm = 424.0857, GNorm = 6.4623, lr_0 = 9.9581e-04
Validation auc = 0.722867
Epoch 6147
Loss = 1.2277e-01, PNorm = 424.1313, GNorm = 0.0284, lr_0 = 9.9581e-04
Validation auc = 0.720412
Epoch 6148
Loss = 7.7680e-03, PNorm = 424.1715, GNorm = 0.3245, lr_0 = 9.9581e-04
Validation auc = 0.716337
Epoch 6149
Loss = 2.7148e-02, PNorm = 424.2028, GNorm = 1.1610, lr_0 = 9.9581e-04
Loss = 2.8196e-02, PNorm = 424.2285, GNorm = 0.5610, lr_0 = 9.9581e-04
Validation auc = 0.716321
Epoch 6150
Loss = 2.8795e-02, PNorm = 424.2691, GNorm = 0.1154, lr_0 = 9.9581e-04
Validation auc = 0.717082
Epoch 6151
Loss = 1.6758e-02, PNorm = 424.2997, GNorm = 0.0792, lr_0 = 9.9581e-04
Validation auc = 0.719553
Epoch 6152
Loss = 1.0202e-02, PNorm = 424.3173, GNorm = 0.1792, lr_0 = 9.9581e-04
Validation auc = 0.720368
Epoch 6153
Loss = 1.5168e-02, PNorm = 424.3307, GNorm = 0.1807, lr_0 = 9.9581e-04
Validation auc = 0.716059
Epoch 6154
Loss = 2.0799e-02, PNorm = 424.3439, GNorm = 0.5857, lr_0 = 9.9581e-04
Validation auc = 0.714570
Epoch 6155
Loss = 7.1145e-02, PNorm = 424.3657, GNorm = 2.8686, lr_0 = 9.9581e-04
Validation auc = 0.722227
Epoch 6156
Loss = 2.2701e-02, PNorm = 424.4039, GNorm = 0.4904, lr_0 = 9.9581e-04
Validation auc = 0.722638
Epoch 6157
Loss = 1.1535e-02, PNorm = 424.4391, GNorm = 0.2328, lr_0 = 9.9581e-04
Validation auc = 0.721443
Epoch 6158
Loss = 1.7348e-03, PNorm = 424.4654, GNorm = 0.0542, lr_0 = 9.9581e-04
Validation auc = 0.717118
Epoch 6159
Loss = 1.5853e-03, PNorm = 424.4882, GNorm = 0.0585, lr_0 = 9.9580e-04
Loss = 9.9966e-03, PNorm = 424.5085, GNorm = 0.1914, lr_0 = 9.9580e-04
Validation auc = 0.714985
Epoch 6160
Loss = 1.1405e-02, PNorm = 424.5243, GNorm = 0.6227, lr_0 = 9.9580e-04
Validation auc = 0.715580
Epoch 6161
Loss = 6.9239e-03, PNorm = 424.5336, GNorm = 1.3537, lr_0 = 9.9580e-04
Validation auc = 0.717389
Epoch 6162
Loss = 7.0240e-03, PNorm = 424.5436, GNorm = 1.2341, lr_0 = 9.9580e-04
Validation auc = 0.713707
Epoch 6163
Loss = 3.2811e-03, PNorm = 424.5599, GNorm = 0.1750, lr_0 = 9.9580e-04
Validation auc = 0.712733
Epoch 6164
Loss = 9.7043e-03, PNorm = 424.5755, GNorm = 0.0233, lr_0 = 9.9580e-04
Validation auc = 0.703863
Epoch 6165
Loss = 1.7352e-02, PNorm = 424.5960, GNorm = 0.0624, lr_0 = 9.9580e-04
Validation auc = 0.707060
Epoch 6166
Loss = 3.6072e-03, PNorm = 424.6244, GNorm = 0.0402, lr_0 = 9.9580e-04
Validation auc = 0.705008
Epoch 6167
Loss = 3.3869e-02, PNorm = 424.6508, GNorm = 0.9467, lr_0 = 9.9580e-04
Validation auc = 0.708917
Epoch 6168
Loss = 2.9324e-03, PNorm = 424.6889, GNorm = 0.0145, lr_0 = 9.9580e-04
Validation auc = 0.710814
Epoch 6169
Loss = 9.1751e-04, PNorm = 424.7212, GNorm = 0.0790, lr_0 = 9.9580e-04
Loss = 1.9357e-02, PNorm = 424.7640, GNorm = 0.2748, lr_0 = 9.9580e-04
Validation auc = 0.705077
Epoch 6170
Loss = 2.1593e-02, PNorm = 424.8111, GNorm = 0.7267, lr_0 = 9.9580e-04
Validation auc = 0.704980
Epoch 6171
Loss = 2.2266e-02, PNorm = 424.8584, GNorm = 0.6206, lr_0 = 9.9580e-04
Validation auc = 0.707687
Epoch 6172
Loss = 2.9267e-02, PNorm = 424.8902, GNorm = 0.1169, lr_0 = 9.9579e-04
Validation auc = 0.708609
Epoch 6173
Loss = 4.3205e-02, PNorm = 424.9141, GNorm = 2.5558, lr_0 = 9.9579e-04
Validation auc = 0.707237
Epoch 6174
Loss = 1.9875e-02, PNorm = 424.9424, GNorm = 0.2056, lr_0 = 9.9579e-04
Validation auc = 0.708333
Epoch 6175
Loss = 3.1494e-02, PNorm = 424.9720, GNorm = 1.2670, lr_0 = 9.9579e-04
Validation auc = 0.700748
Epoch 6176
Loss = 5.8606e-03, PNorm = 424.9973, GNorm = 1.0411, lr_0 = 9.9579e-04
Validation auc = 0.703448
Epoch 6177
Loss = 2.0119e-02, PNorm = 425.0232, GNorm = 1.7330, lr_0 = 9.9579e-04
Validation auc = 0.707261
Epoch 6178
Loss = 5.7097e-02, PNorm = 425.0462, GNorm = 0.5463, lr_0 = 9.9579e-04
Validation auc = 0.703548
Epoch 6179
Loss = 2.4777e-02, PNorm = 425.0693, GNorm = 1.2047, lr_0 = 9.9579e-04
Loss = 1.2591e-02, PNorm = 425.1016, GNorm = 0.9423, lr_0 = 9.9579e-04
Validation auc = 0.699031
Epoch 6180
Loss = 3.4437e-02, PNorm = 425.1298, GNorm = 0.0796, lr_0 = 9.9579e-04
Validation auc = 0.701696
Epoch 6181
Loss = 1.6354e-02, PNorm = 425.1623, GNorm = 0.0501, lr_0 = 9.9579e-04
Validation auc = 0.700471
Epoch 6182
Loss = 2.5838e-02, PNorm = 425.1985, GNorm = 0.5786, lr_0 = 9.9579e-04
Validation auc = 0.699981
Epoch 6183
Loss = 1.3774e-02, PNorm = 425.2289, GNorm = 0.0448, lr_0 = 9.9579e-04
Validation auc = 0.696430
Epoch 6184
Loss = 4.1247e-02, PNorm = 425.2575, GNorm = 1.2398, lr_0 = 9.9579e-04
Validation auc = 0.693255
Epoch 6185
Loss = 3.4462e-02, PNorm = 425.2867, GNorm = 1.0887, lr_0 = 9.9578e-04
Validation auc = 0.691616
Epoch 6186
Loss = 1.1057e-02, PNorm = 425.3167, GNorm = 0.1288, lr_0 = 9.9578e-04
Validation auc = 0.693096
Epoch 6187
Loss = 5.8321e-03, PNorm = 425.3412, GNorm = 0.6308, lr_0 = 9.9578e-04
Validation auc = 0.697913
Epoch 6188
Loss = 1.0693e-02, PNorm = 425.3602, GNorm = 0.8740, lr_0 = 9.9578e-04
Validation auc = 0.693052
Epoch 6189
Loss = 9.0390e-03, PNorm = 425.3855, GNorm = 0.4508, lr_0 = 9.9578e-04
Loss = 7.2279e-03, PNorm = 425.4135, GNorm = 0.1187, lr_0 = 9.9578e-04
Validation auc = 0.692250
Epoch 6190
Loss = 1.6534e-02, PNorm = 425.4332, GNorm = 1.1472, lr_0 = 9.9578e-04
Validation auc = 0.698820
Epoch 6191
Loss = 8.2244e-03, PNorm = 425.4561, GNorm = 0.4613, lr_0 = 9.9578e-04
Validation auc = 0.708695
Epoch 6192
Loss = 1.9772e-02, PNorm = 425.4747, GNorm = 1.1539, lr_0 = 9.9578e-04
Validation auc = 0.703738
Epoch 6193
Loss = 2.6218e-02, PNorm = 425.4966, GNorm = 1.4857, lr_0 = 9.9578e-04
Validation auc = 0.711154
Epoch 6194
Loss = 2.5777e-02, PNorm = 425.5279, GNorm = 0.1467, lr_0 = 9.9578e-04
Validation auc = 0.710733
Epoch 6195
Loss = 1.6328e-02, PNorm = 425.5509, GNorm = 0.0267, lr_0 = 9.9578e-04
Validation auc = 0.708785
Epoch 6196
Loss = 9.9178e-03, PNorm = 425.5712, GNorm = 0.7897, lr_0 = 9.9578e-04
Validation auc = 0.706072
Epoch 6197
Loss = 4.4470e-02, PNorm = 425.5937, GNorm = 1.7443, lr_0 = 9.9578e-04
Validation auc = 0.701158
Epoch 6198
Loss = 3.9192e-02, PNorm = 425.6163, GNorm = 2.7748, lr_0 = 9.9578e-04
Validation auc = 0.699056
Epoch 6199
Loss = 2.1817e-01, PNorm = 425.6436, GNorm = 2.4281, lr_0 = 9.9577e-04
Loss = 8.8901e-03, PNorm = 425.6673, GNorm = 0.1204, lr_0 = 9.9577e-04
Validation auc = 0.694664
Epoch 6200
Loss = 3.1678e-02, PNorm = 425.6914, GNorm = 0.1732, lr_0 = 9.9577e-04
Validation auc = 0.699374
Epoch 6201
Loss = 1.5489e-02, PNorm = 425.7311, GNorm = 0.5769, lr_0 = 9.9577e-04
Validation auc = 0.699431
Epoch 6202
Loss = 3.2111e-02, PNorm = 425.7722, GNorm = 0.1632, lr_0 = 9.9577e-04
Validation auc = 0.700594
Epoch 6203
Loss = 1.6544e-02, PNorm = 425.8012, GNorm = 1.1957, lr_0 = 9.9577e-04
Validation auc = 0.696289
Epoch 6204
Loss = 3.8692e-03, PNorm = 425.8217, GNorm = 0.3636, lr_0 = 9.9577e-04
Validation auc = 0.693088
Epoch 6205
Loss = 8.6494e-03, PNorm = 425.8374, GNorm = 1.2489, lr_0 = 9.9577e-04
Validation auc = 0.691601
Epoch 6206
Loss = 2.7382e-02, PNorm = 425.8557, GNorm = 0.9524, lr_0 = 9.9577e-04
Validation auc = 0.686862
Epoch 6207
Loss = 2.0843e-03, PNorm = 425.8739, GNorm = 0.1670, lr_0 = 9.9577e-04
Validation auc = 0.684322
Epoch 6208
Loss = 1.9504e-02, PNorm = 425.8879, GNorm = 3.2681, lr_0 = 9.9577e-04
Validation auc = 0.679503
Epoch 6209
Loss = 2.9762e-02, PNorm = 425.9078, GNorm = 1.6920, lr_0 = 9.9577e-04
Loss = 2.7176e-02, PNorm = 425.9348, GNorm = 0.0727, lr_0 = 9.9577e-04
Validation auc = 0.685916
Epoch 6210
Loss = 3.5293e-02, PNorm = 425.9631, GNorm = 1.1033, lr_0 = 9.9577e-04
Validation auc = 0.685667
Epoch 6211
Loss = 1.8682e-02, PNorm = 425.9937, GNorm = 0.0796, lr_0 = 9.9576e-04
Validation auc = 0.687253
Epoch 6212
Loss = 7.6208e-03, PNorm = 426.0168, GNorm = 0.1615, lr_0 = 9.9576e-04
Validation auc = 0.691232
Epoch 6213
Loss = 1.1466e-02, PNorm = 426.0317, GNorm = 0.0412, lr_0 = 9.9576e-04
Validation auc = 0.691824
Epoch 6214
Loss = 3.7306e-02, PNorm = 426.0457, GNorm = 0.0616, lr_0 = 9.9576e-04
Validation auc = 0.697396
Epoch 6215
Loss = 1.6824e-02, PNorm = 426.0677, GNorm = 1.8704, lr_0 = 9.9576e-04
Validation auc = 0.701611
Epoch 6216
Loss = 5.5322e-03, PNorm = 426.0930, GNorm = 0.1000, lr_0 = 9.9576e-04
Validation auc = 0.697406
Epoch 6217
Loss = 3.9114e-02, PNorm = 426.1143, GNorm = 0.2063, lr_0 = 9.9576e-04
Validation auc = 0.700861
Epoch 6218
Loss = 1.6626e-03, PNorm = 426.1444, GNorm = 0.2263, lr_0 = 9.9576e-04
Validation auc = 0.691997
Epoch 6219
Loss = 1.8859e-03, PNorm = 426.1937, GNorm = 0.0608, lr_0 = 9.9576e-04
Loss = 1.9435e-02, PNorm = 426.2431, GNorm = 0.1506, lr_0 = 9.9576e-04
Validation auc = 0.684728
Epoch 6220
Loss = 3.2491e-02, PNorm = 426.2900, GNorm = 0.9506, lr_0 = 9.9576e-04
Validation auc = 0.684008
Epoch 6221
Loss = 2.9381e-02, PNorm = 426.3387, GNorm = 0.1158, lr_0 = 9.9576e-04
Validation auc = 0.689428
Epoch 6222
Loss = 9.1127e-03, PNorm = 426.3723, GNorm = 2.4971, lr_0 = 9.9576e-04
Validation auc = 0.691091
Epoch 6223
Loss = 1.3198e-02, PNorm = 426.4021, GNorm = 0.2168, lr_0 = 9.9576e-04
Validation auc = 0.692680
Epoch 6224
Loss = 8.2921e-03, PNorm = 426.4340, GNorm = 0.0799, lr_0 = 9.9576e-04
Validation auc = 0.690517
Epoch 6225
Loss = 1.9935e-02, PNorm = 426.4564, GNorm = 2.1363, lr_0 = 9.9575e-04
Validation auc = 0.690405
Epoch 6226
Loss = 3.3212e-03, PNorm = 426.4768, GNorm = 0.6350, lr_0 = 9.9575e-04
Validation auc = 0.688504
Epoch 6227
Loss = 2.0941e-02, PNorm = 426.4995, GNorm = 1.5986, lr_0 = 9.9575e-04
Validation auc = 0.687291
Epoch 6228
Loss = 4.8548e-02, PNorm = 426.5322, GNorm = 1.0838, lr_0 = 9.9575e-04
Validation auc = 0.691015
Epoch 6229
Loss = 8.8341e-04, PNorm = 426.5754, GNorm = 0.0413, lr_0 = 9.9575e-04
Loss = 2.0646e-02, PNorm = 426.6144, GNorm = 2.5486, lr_0 = 9.9575e-04
Validation auc = 0.688659
Epoch 6230
Loss = 9.5834e-02, PNorm = 426.6657, GNorm = 1.1164, lr_0 = 9.9575e-04
Validation auc = 0.698127
Epoch 6231
Loss = 5.1132e-02, PNorm = 426.7497, GNorm = 0.6099, lr_0 = 9.9575e-04
Validation auc = 0.697592
Epoch 6232
Loss = 2.0914e-02, PNorm = 426.8140, GNorm = 0.3356, lr_0 = 9.9575e-04
Validation auc = 0.698747
Epoch 6233
Loss = 4.1466e-02, PNorm = 426.8537, GNorm = 3.2329, lr_0 = 9.9575e-04
Validation auc = 0.702511
Epoch 6234
Loss = 3.0572e-02, PNorm = 426.8871, GNorm = 0.2079, lr_0 = 9.9575e-04
Validation auc = 0.706537
Epoch 6235
Loss = 3.6312e-02, PNorm = 426.9267, GNorm = 1.1655, lr_0 = 9.9575e-04
Validation auc = 0.704712
Epoch 6236
Loss = 1.5187e-02, PNorm = 426.9697, GNorm = 0.1350, lr_0 = 9.9575e-04
Validation auc = 0.709333
Epoch 6237
Loss = 4.0493e-03, PNorm = 427.0084, GNorm = 0.0766, lr_0 = 9.9575e-04
Validation auc = 0.708999
Epoch 6238
Loss = 5.0876e-02, PNorm = 427.0384, GNorm = 2.1864, lr_0 = 9.9575e-04
Validation auc = 0.712509
Epoch 6239
Loss = 3.0205e-03, PNorm = 427.0658, GNorm = 0.1497, lr_0 = 9.9574e-04
Loss = 2.0162e-02, PNorm = 427.0923, GNorm = 1.0105, lr_0 = 9.9574e-04
Validation auc = 0.716356
Epoch 6240
Loss = 2.0386e-02, PNorm = 427.1172, GNorm = 0.0401, lr_0 = 9.9574e-04
Validation auc = 0.714193
Epoch 6241
Loss = 1.3776e-02, PNorm = 427.1424, GNorm = 0.1675, lr_0 = 9.9574e-04
Validation auc = 0.710269
Epoch 6242
Loss = 1.3798e-02, PNorm = 427.1683, GNorm = 0.8302, lr_0 = 9.9574e-04
Validation auc = 0.712490
Epoch 6243
Loss = 4.3120e-02, PNorm = 427.1958, GNorm = 0.5801, lr_0 = 9.9574e-04
Validation auc = 0.711070
Epoch 6244
Loss = 4.1346e-02, PNorm = 427.2349, GNorm = 0.8539, lr_0 = 9.9574e-04
Validation auc = 0.715237
Epoch 6245
Loss = 1.8223e-02, PNorm = 427.2707, GNorm = 0.1764, lr_0 = 9.9574e-04
Validation auc = 0.716330
Epoch 6246
Loss = 3.0560e-02, PNorm = 427.2989, GNorm = 1.3403, lr_0 = 9.9574e-04
Validation auc = 0.715149
Epoch 6247
Loss = 2.8702e-02, PNorm = 427.3345, GNorm = 2.2636, lr_0 = 9.9574e-04
Validation auc = 0.717081
Epoch 6248
Loss = 2.1313e-02, PNorm = 427.3705, GNorm = 1.1142, lr_0 = 9.9574e-04
Validation auc = 0.714888
Epoch 6249
Loss = 7.1956e-03, PNorm = 427.4029, GNorm = 0.2593, lr_0 = 9.9574e-04
Loss = 6.6938e-03, PNorm = 427.4279, GNorm = 0.0472, lr_0 = 9.9574e-04
Validation auc = 0.710760
Epoch 6250
Loss = 3.1596e-02, PNorm = 427.4556, GNorm = 1.4701, lr_0 = 9.9574e-04
Validation auc = 0.708989
Epoch 6251
Loss = 4.6473e-02, PNorm = 427.5040, GNorm = 1.7410, lr_0 = 9.9573e-04
Validation auc = 0.704424
Epoch 6252
Loss = 3.9093e-02, PNorm = 427.5651, GNorm = 0.5837, lr_0 = 9.9573e-04
Validation auc = 0.700641
Epoch 6253
Loss = 1.5648e-02, PNorm = 427.6087, GNorm = 1.2050, lr_0 = 9.9573e-04
Validation auc = 0.699372
Epoch 6254
Loss = 1.5143e-02, PNorm = 427.6421, GNorm = 1.0089, lr_0 = 9.9573e-04
Validation auc = 0.693333
Epoch 6255
Loss = 7.4440e-03, PNorm = 427.6726, GNorm = 0.7748, lr_0 = 9.9573e-04
Validation auc = 0.688413
Epoch 6256
Loss = 3.7503e-02, PNorm = 427.6944, GNorm = 1.5229, lr_0 = 9.9573e-04
Validation auc = 0.686541
Epoch 6257
Loss = 3.9505e-03, PNorm = 427.7116, GNorm = 0.0203, lr_0 = 9.9573e-04
Validation auc = 0.689566
Epoch 6258
Loss = 4.2053e-03, PNorm = 427.7259, GNorm = 0.1127, lr_0 = 9.9573e-04
Validation auc = 0.689438
Epoch 6259
Loss = 5.3602e-03, PNorm = 427.7492, GNorm = 0.1859, lr_0 = 9.9573e-04
Loss = 2.6603e-02, PNorm = 427.7780, GNorm = 0.1062, lr_0 = 9.9573e-04
Validation auc = 0.699229
Epoch 6260
Loss = 2.0821e-02, PNorm = 427.7998, GNorm = 0.3096, lr_0 = 9.9573e-04
Validation auc = 0.703178
Epoch 6261
Loss = 3.9585e-02, PNorm = 427.8256, GNorm = 0.6850, lr_0 = 9.9573e-04
Validation auc = 0.705592
Epoch 6262
Loss = 2.4532e-02, PNorm = 427.8569, GNorm = 1.0675, lr_0 = 9.9573e-04
Validation auc = 0.713250
Epoch 6263
Loss = 4.7234e-02, PNorm = 427.8886, GNorm = 2.6757, lr_0 = 9.9573e-04
Validation auc = 0.707343
Epoch 6264
Loss = 1.7757e-02, PNorm = 427.9245, GNorm = 1.5578, lr_0 = 9.9573e-04
Validation auc = 0.705519
Epoch 6265
Loss = 1.7390e-02, PNorm = 427.9629, GNorm = 0.2425, lr_0 = 9.9572e-04
Validation auc = 0.708196
Epoch 6266
Loss = 5.8870e-03, PNorm = 428.0026, GNorm = 0.2013, lr_0 = 9.9572e-04
Validation auc = 0.711676
Epoch 6267
Loss = 5.0188e-03, PNorm = 428.0321, GNorm = 0.2998, lr_0 = 9.9572e-04
Validation auc = 0.713726
Epoch 6268
Loss = 3.7890e-03, PNorm = 428.0623, GNorm = 0.5605, lr_0 = 9.9572e-04
Validation auc = 0.713494
Epoch 6269
Loss = 1.0776e-03, PNorm = 428.0871, GNorm = 0.0582, lr_0 = 9.9572e-04
Loss = 1.3644e-02, PNorm = 428.1032, GNorm = 0.1106, lr_0 = 9.9572e-04
Validation auc = 0.716345
Epoch 6270
Loss = 1.7276e-02, PNorm = 428.1195, GNorm = 0.1519, lr_0 = 9.9572e-04
Validation auc = 0.715828
Epoch 6271
Loss = 2.4018e-02, PNorm = 428.1381, GNorm = 0.4895, lr_0 = 9.9572e-04
Validation auc = 0.714042
Epoch 6272
Loss = 1.0147e-02, PNorm = 428.1751, GNorm = 0.8178, lr_0 = 9.9572e-04
Validation auc = 0.718217
Epoch 6273
Loss = 1.5320e-02, PNorm = 428.2011, GNorm = 0.0132, lr_0 = 9.9572e-04
Validation auc = 0.716712
Epoch 6274
Loss = 2.6659e-02, PNorm = 428.2246, GNorm = 0.3817, lr_0 = 9.9572e-04
Validation auc = 0.715283
Epoch 6275
Loss = 1.8526e-03, PNorm = 428.2441, GNorm = 0.0358, lr_0 = 9.9572e-04
Validation auc = 0.714238
Epoch 6276
Loss = 2.2390e-02, PNorm = 428.2586, GNorm = 3.2723, lr_0 = 9.9572e-04
Validation auc = 0.715191
Epoch 6277
Loss = 2.5652e-03, PNorm = 428.2788, GNorm = 0.2781, lr_0 = 9.9572e-04
Validation auc = 0.718120
Epoch 6278
Loss = 2.8851e-02, PNorm = 428.3028, GNorm = 2.0444, lr_0 = 9.9571e-04
Validation auc = 0.716539
Epoch 6279
Loss = 5.5853e-03, PNorm = 428.3364, GNorm = 0.2321, lr_0 = 9.9571e-04
Loss = 2.5159e-02, PNorm = 428.3682, GNorm = 1.4724, lr_0 = 9.9571e-04
Validation auc = 0.715828
Epoch 6280
Loss = 3.1052e-02, PNorm = 428.4047, GNorm = 0.2317, lr_0 = 9.9571e-04
Validation auc = 0.717412
Epoch 6281
Loss = 2.5628e-02, PNorm = 428.4509, GNorm = 0.4907, lr_0 = 9.9571e-04
Validation auc = 0.715891
Epoch 6282
Loss = 2.3112e-02, PNorm = 428.5008, GNorm = 1.4875, lr_0 = 9.9571e-04
Validation auc = 0.709020
Epoch 6283
Loss = 5.1055e-03, PNorm = 428.5463, GNorm = 1.4508, lr_0 = 9.9571e-04
Validation auc = 0.707909
Epoch 6284
Loss = 1.7968e-02, PNorm = 428.5761, GNorm = 1.3550, lr_0 = 9.9571e-04
Validation auc = 0.709734
Epoch 6285
Loss = 6.3004e-03, PNorm = 428.6009, GNorm = 0.4927, lr_0 = 9.9571e-04
Validation auc = 0.712965
Epoch 6286
Loss = 6.7058e-03, PNorm = 428.6221, GNorm = 0.5017, lr_0 = 9.9571e-04
Validation auc = 0.712774
Epoch 6287
Loss = 3.7929e-02, PNorm = 428.6431, GNorm = 1.1824, lr_0 = 9.9571e-04
Validation auc = 0.716617
Epoch 6288
Loss = 3.4057e-02, PNorm = 428.6691, GNorm = 2.0681, lr_0 = 9.9571e-04
Validation auc = 0.722750
Epoch 6289
Loss = 3.6566e-02, PNorm = 428.7024, GNorm = 1.9812, lr_0 = 9.9571e-04
Loss = 2.3094e-02, PNorm = 428.7360, GNorm = 0.3111, lr_0 = 9.9571e-04
Validation auc = 0.719952
Epoch 6290
Loss = 1.7162e-02, PNorm = 428.7686, GNorm = 0.0040, lr_0 = 9.9571e-04
Validation auc = 0.718313
Epoch 6291
Loss = 2.0627e-02, PNorm = 428.7961, GNorm = 0.2544, lr_0 = 9.9570e-04
Validation auc = 0.719786
Epoch 6292
Loss = 1.3689e-02, PNorm = 428.8202, GNorm = 0.1405, lr_0 = 9.9570e-04
Validation auc = 0.723111
Epoch 6293
Loss = 5.4690e-03, PNorm = 428.8343, GNorm = 0.0479, lr_0 = 9.9570e-04
Validation auc = 0.723466
Epoch 6294
Loss = 6.7901e-03, PNorm = 428.8449, GNorm = 0.0117, lr_0 = 9.9570e-04
Validation auc = 0.723574
Epoch 6295
Loss = 1.1900e-03, PNorm = 428.8547, GNorm = 0.3313, lr_0 = 9.9570e-04
Validation auc = 0.722893
Epoch 6296
Loss = 1.8184e-02, PNorm = 428.8713, GNorm = 1.5179, lr_0 = 9.9570e-04
Validation auc = 0.716766
Epoch 6297
Loss = 1.0463e-02, PNorm = 428.8987, GNorm = 0.1869, lr_0 = 9.9570e-04
Validation auc = 0.726083
Epoch 6298
Loss = 2.6459e-03, PNorm = 428.9350, GNorm = 0.0896, lr_0 = 9.9570e-04
Validation auc = 0.724418
Epoch 6299
Loss = 1.0475e-02, PNorm = 428.9674, GNorm = 0.3670, lr_0 = 9.9570e-04
Loss = 3.2405e-02, PNorm = 428.9999, GNorm = 0.1671, lr_0 = 9.9570e-04
Validation auc = 0.720361
Epoch 6300
Loss = 1.4965e-02, PNorm = 429.0249, GNorm = 0.2090, lr_0 = 9.9570e-04
Validation auc = 0.721675
Epoch 6301
Loss = 4.4939e-02, PNorm = 429.0597, GNorm = 1.5796, lr_0 = 9.9570e-04
Validation auc = 0.726155
Epoch 6302
Loss = 9.5759e-03, PNorm = 429.0928, GNorm = 0.0539, lr_0 = 9.9570e-04
Validation auc = 0.728739
Epoch 6303
Loss = 5.8577e-02, PNorm = 429.1246, GNorm = 1.1629, lr_0 = 9.9570e-04
Validation auc = 0.721255
Epoch 6304
Loss = 3.7259e-02, PNorm = 429.1631, GNorm = 1.3591, lr_0 = 9.9570e-04
Validation auc = 0.727120
Epoch 6305
Loss = 3.8265e-02, PNorm = 429.2118, GNorm = 0.7583, lr_0 = 9.9569e-04
Validation auc = 0.732504
Epoch 6306
Loss = 2.1594e-02, PNorm = 429.2613, GNorm = 0.6614, lr_0 = 9.9569e-04
Validation auc = 0.728167
Epoch 6307
Loss = 3.1597e-02, PNorm = 429.3032, GNorm = 0.1093, lr_0 = 9.9569e-04
Validation auc = 0.720046
Epoch 6308
Loss = 2.2025e-02, PNorm = 429.3400, GNorm = 0.2385, lr_0 = 9.9569e-04
Validation auc = 0.718511
Epoch 6309
Loss = 1.3521e-03, PNorm = 429.3731, GNorm = 0.0700, lr_0 = 9.9569e-04
Loss = 1.4403e-02, PNorm = 429.4009, GNorm = 0.1267, lr_0 = 9.9569e-04
Validation auc = 0.724672
Epoch 6310
Loss = 2.6052e-02, PNorm = 429.4233, GNorm = 0.1357, lr_0 = 9.9569e-04
Validation auc = 0.718872
Epoch 6311
Loss = 2.1466e-02, PNorm = 429.4579, GNorm = 1.2823, lr_0 = 9.9569e-04
Validation auc = 0.718600
Epoch 6312
Loss = 1.1035e-02, PNorm = 429.4964, GNorm = 0.3206, lr_0 = 9.9569e-04
Validation auc = 0.718685
Epoch 6313
Loss = 3.7723e-02, PNorm = 429.5259, GNorm = 3.0719, lr_0 = 9.9569e-04
Validation auc = 0.723770
Epoch 6314
Loss = 2.7566e-02, PNorm = 429.5704, GNorm = 0.1830, lr_0 = 9.9569e-04
Validation auc = 0.722735
Epoch 6315
Loss = 7.5603e-03, PNorm = 429.6119, GNorm = 0.0138, lr_0 = 9.9569e-04
Validation auc = 0.724412
Epoch 6316
Loss = 5.0840e-03, PNorm = 429.6370, GNorm = 0.0864, lr_0 = 9.9569e-04
Validation auc = 0.722120
Epoch 6317
Loss = 2.2797e-03, PNorm = 429.6503, GNorm = 0.3831, lr_0 = 9.9569e-04
Validation auc = 0.718181
Epoch 6318
Loss = 2.3504e-01, PNorm = 429.6604, GNorm = 2.6158, lr_0 = 9.9568e-04
Validation auc = 0.715365
Epoch 6319
Loss = 4.5594e-02, PNorm = 429.6774, GNorm = 1.6112, lr_0 = 9.9568e-04
Loss = 1.4310e-02, PNorm = 429.7049, GNorm = 0.3175, lr_0 = 9.9568e-04
Validation auc = 0.711621
Epoch 6320
Loss = 4.4929e-02, PNorm = 429.7233, GNorm = 0.6695, lr_0 = 9.9568e-04
Validation auc = 0.709768
Epoch 6321
Loss = 2.1088e-02, PNorm = 429.7511, GNorm = 0.2247, lr_0 = 9.9568e-04
Validation auc = 0.712564
Epoch 6322
Loss = 9.2891e-03, PNorm = 429.7827, GNorm = 0.7233, lr_0 = 9.9568e-04
Validation auc = 0.708501
Epoch 6323
Loss = 2.6285e-02, PNorm = 429.8098, GNorm = 0.1965, lr_0 = 9.9568e-04
Validation auc = 0.705396
Epoch 6324
Loss = 3.6332e-03, PNorm = 429.8381, GNorm = 0.4447, lr_0 = 9.9568e-04
Validation auc = 0.704225
Epoch 6325
Loss = 1.5758e-02, PNorm = 429.8594, GNorm = 0.4632, lr_0 = 9.9568e-04
Validation auc = 0.706979
Epoch 6326
Loss = 8.3303e-04, PNorm = 429.8799, GNorm = 0.0596, lr_0 = 9.9568e-04
Validation auc = 0.714351
Epoch 6327
Loss = 8.1599e-02, PNorm = 429.9003, GNorm = 3.3643, lr_0 = 9.9568e-04
Validation auc = 0.714239
Epoch 6328
Loss = 5.3118e-03, PNorm = 429.9438, GNorm = 0.4786, lr_0 = 9.9568e-04
Validation auc = 0.717001
Epoch 6329
Loss = 3.5350e-02, PNorm = 430.0061, GNorm = 1.0301, lr_0 = 9.9568e-04
Loss = 2.3966e-02, PNorm = 430.0678, GNorm = 0.2085, lr_0 = 9.9568e-04
Validation auc = 0.710850
Epoch 6330
Loss = 2.4474e-02, PNorm = 430.1093, GNorm = 0.1837, lr_0 = 9.9568e-04
Validation auc = 0.719692
Epoch 6331
Loss = 5.1041e-02, PNorm = 430.1515, GNorm = 0.0784, lr_0 = 9.9567e-04
Validation auc = 0.717670
Epoch 6332
Loss = 2.3949e-02, PNorm = 430.1929, GNorm = 0.2273, lr_0 = 9.9567e-04
Validation auc = 0.719275
Epoch 6333
Loss = 1.9278e-02, PNorm = 430.2280, GNorm = 0.1382, lr_0 = 9.9567e-04
Validation auc = 0.721176
Epoch 6334
Loss = 5.2316e-02, PNorm = 430.2598, GNorm = 1.5413, lr_0 = 9.9567e-04
Validation auc = 0.724336
Epoch 6335
Loss = 1.6613e-02, PNorm = 430.2932, GNorm = 0.6618, lr_0 = 9.9567e-04
Validation auc = 0.706908
Epoch 6336
Loss = 1.9761e-02, PNorm = 430.3252, GNorm = 2.3611, lr_0 = 9.9567e-04
Validation auc = 0.712902
Epoch 6337
Loss = 7.9277e-03, PNorm = 430.3540, GNorm = 0.2710, lr_0 = 9.9567e-04
Validation auc = 0.704235
Epoch 6338
Loss = 1.2758e-02, PNorm = 430.3802, GNorm = 1.6986, lr_0 = 9.9567e-04
Validation auc = 0.709213
Epoch 6339
Loss = 1.0851e-01, PNorm = 430.4046, GNorm = 1.2726, lr_0 = 9.9567e-04
Loss = 1.5536e-02, PNorm = 430.4288, GNorm = 6.9761, lr_0 = 9.9567e-04
Validation auc = 0.702361
Epoch 6340
Loss = 2.3941e-02, PNorm = 430.4621, GNorm = 0.0662, lr_0 = 9.9567e-04
Validation auc = 0.707070
Epoch 6341
Loss = 2.4427e-02, PNorm = 430.4993, GNorm = 1.2941, lr_0 = 9.9567e-04
Validation auc = 0.700479
Epoch 6342
Loss = 2.7894e-02, PNorm = 430.5501, GNorm = 0.1038, lr_0 = 9.9567e-04
Validation auc = 0.690281
Epoch 6343
Loss = 1.7584e-02, PNorm = 430.5904, GNorm = 2.9346, lr_0 = 9.9567e-04
Validation auc = 0.688194
Epoch 6344
Loss = 2.4287e-02, PNorm = 430.6245, GNorm = 0.5670, lr_0 = 9.9566e-04
Validation auc = 0.687845
Epoch 6345
Loss = 7.4499e-02, PNorm = 430.6573, GNorm = 8.2304, lr_0 = 9.9566e-04
Validation auc = 0.698377
Epoch 6346
Loss = 3.9009e-02, PNorm = 430.7136, GNorm = 1.6245, lr_0 = 9.9566e-04
Validation auc = 0.706227
Epoch 6347
Loss = 1.7873e-02, PNorm = 430.7705, GNorm = 0.7396, lr_0 = 9.9566e-04
Validation auc = 0.703355
Epoch 6348
Loss = 5.9663e-03, PNorm = 430.8308, GNorm = 0.1001, lr_0 = 9.9566e-04
Validation auc = 0.698723
Epoch 6349
Loss = 2.9531e-02, PNorm = 430.8736, GNorm = 0.9259, lr_0 = 9.9566e-04
Loss = 3.5338e-02, PNorm = 430.9095, GNorm = 2.0431, lr_0 = 9.9566e-04
Validation auc = 0.696629
Epoch 6350
Loss = 1.6378e-02, PNorm = 430.9497, GNorm = 0.0386, lr_0 = 9.9566e-04
Validation auc = 0.695032
Epoch 6351
Loss = 5.2734e-03, PNorm = 430.9794, GNorm = 0.0458, lr_0 = 9.9566e-04
Validation auc = 0.700639
Epoch 6352
Loss = 1.0378e-02, PNorm = 430.9984, GNorm = 0.8919, lr_0 = 9.9566e-04
Validation auc = 0.700764
Epoch 6353
Loss = 1.0404e-02, PNorm = 431.0192, GNorm = 0.0387, lr_0 = 9.9566e-04
Validation auc = 0.700948
Epoch 6354
Loss = 7.5076e-03, PNorm = 431.0393, GNorm = 1.0894, lr_0 = 9.9566e-04
Validation auc = 0.708407
Epoch 6355
Loss = 1.0277e-02, PNorm = 431.0712, GNorm = 0.0294, lr_0 = 9.9566e-04
Validation auc = 0.708415
Epoch 6356
Loss = 1.9731e-02, PNorm = 431.1003, GNorm = 0.9317, lr_0 = 9.9566e-04
Validation auc = 0.709281
Epoch 6357
Loss = 1.1254e-01, PNorm = 431.1261, GNorm = 1.5455, lr_0 = 9.9566e-04
Validation auc = 0.708055
Epoch 6358
Loss = 2.9591e-02, PNorm = 431.1564, GNorm = 2.9508, lr_0 = 9.9565e-04
Validation auc = 0.702877
Epoch 6359
Loss = 8.0466e-02, PNorm = 431.1913, GNorm = 6.3544, lr_0 = 9.9565e-04
Loss = 3.9575e-02, PNorm = 431.2359, GNorm = 0.1279, lr_0 = 9.9565e-04
Validation auc = 0.702906
Epoch 6360
Loss = 4.7690e-02, PNorm = 431.2846, GNorm = 2.4124, lr_0 = 9.9565e-04
Validation auc = 0.700033
Epoch 6361
Loss = 4.4886e-02, PNorm = 431.3288, GNorm = 1.9059, lr_0 = 9.9565e-04
Validation auc = 0.702136
Epoch 6362
Loss = 2.3159e-02, PNorm = 431.3776, GNorm = 0.0268, lr_0 = 9.9565e-04
Validation auc = 0.703234
Epoch 6363
Loss = 2.3335e-02, PNorm = 431.4047, GNorm = 1.2275, lr_0 = 9.9565e-04
Validation auc = 0.704788
Epoch 6364
Loss = 1.4472e-02, PNorm = 431.4285, GNorm = 0.0423, lr_0 = 9.9565e-04
Validation auc = 0.699568
Epoch 6365
Loss = 8.5686e-03, PNorm = 431.4584, GNorm = 0.0738, lr_0 = 9.9565e-04
Validation auc = 0.708765
Epoch 6366
Loss = 2.2889e-02, PNorm = 431.4874, GNorm = 0.1219, lr_0 = 9.9565e-04
Validation auc = 0.705948
Epoch 6367
Loss = 2.0963e-02, PNorm = 431.5145, GNorm = 2.5179, lr_0 = 9.9565e-04
Validation auc = 0.711344
Epoch 6368
Loss = 1.0208e-03, PNorm = 431.5409, GNorm = 0.0607, lr_0 = 9.9565e-04
Validation auc = 0.704981
Epoch 6369
Loss = 2.9815e-02, PNorm = 431.5694, GNorm = 2.2356, lr_0 = 9.9565e-04
Loss = 1.9339e-02, PNorm = 431.6046, GNorm = 0.0582, lr_0 = 9.9565e-04
Validation auc = 0.706174
Epoch 6370
Loss = 1.6947e-02, PNorm = 431.6342, GNorm = 0.7477, lr_0 = 9.9565e-04
Validation auc = 0.708319
Epoch 6371
Loss = 2.8084e-02, PNorm = 431.6573, GNorm = 1.8734, lr_0 = 9.9564e-04
Validation auc = 0.714882
Epoch 6372
Loss = 1.8607e-02, PNorm = 431.6790, GNorm = 0.0943, lr_0 = 9.9564e-04
Validation auc = 0.712885
Epoch 6373
Loss = 4.5832e-02, PNorm = 431.7023, GNorm = 0.9448, lr_0 = 9.9564e-04
Validation auc = 0.713751
Epoch 6374
Loss = 1.7067e-02, PNorm = 431.7492, GNorm = 0.7965, lr_0 = 9.9564e-04
Validation auc = 0.725507
Epoch 6375
Loss = 5.0468e-02, PNorm = 431.8016, GNorm = 0.0058, lr_0 = 9.9564e-04
Validation auc = 0.717008
Epoch 6376
Loss = 3.9191e-02, PNorm = 431.8436, GNorm = 1.5218, lr_0 = 9.9564e-04
Validation auc = 0.714613
Epoch 6377
Loss = 7.1517e-02, PNorm = 431.8904, GNorm = 3.0065, lr_0 = 9.9564e-04
Validation auc = 0.718213
Epoch 6378
Loss = 4.5725e-02, PNorm = 431.9374, GNorm = 1.3913, lr_0 = 9.9564e-04
Validation auc = 0.717333
Epoch 6379
Loss = 5.0999e-02, PNorm = 432.0002, GNorm = 1.8437, lr_0 = 9.9564e-04
Loss = 3.5382e-02, PNorm = 432.0605, GNorm = 0.1608, lr_0 = 9.9564e-04
Validation auc = 0.722640
Epoch 6380
Loss = 3.7126e-02, PNorm = 432.1070, GNorm = 1.8220, lr_0 = 9.9564e-04
Validation auc = 0.726009
Epoch 6381
Loss = 2.5956e-02, PNorm = 432.1503, GNorm = 1.0583, lr_0 = 9.9564e-04
Validation auc = 0.722970
Epoch 6382
Loss = 2.9511e-02, PNorm = 432.1843, GNorm = 0.4824, lr_0 = 9.9564e-04
Validation auc = 0.719050
Epoch 6383
Loss = 4.4239e-02, PNorm = 432.2172, GNorm = 2.6081, lr_0 = 9.9564e-04
Validation auc = 0.729044
Epoch 6384
Loss = 2.8329e-02, PNorm = 432.2565, GNorm = 0.9227, lr_0 = 9.9563e-04
Validation auc = 0.729567
Epoch 6385
Loss = 2.8361e-02, PNorm = 432.2931, GNorm = 0.3314, lr_0 = 9.9563e-04
Validation auc = 0.721928
Epoch 6386
Loss = 1.6337e-02, PNorm = 432.3286, GNorm = 0.7914, lr_0 = 9.9563e-04
Validation auc = 0.718114
Epoch 6387
Loss = 1.2141e-02, PNorm = 432.3557, GNorm = 3.2121, lr_0 = 9.9563e-04
Validation auc = 0.721961
Epoch 6388
Loss = 1.1032e-02, PNorm = 432.3804, GNorm = 1.4866, lr_0 = 9.9563e-04
Validation auc = 0.722830
Epoch 6389
Loss = 3.9469e-03, PNorm = 432.4039, GNorm = 0.1787, lr_0 = 9.9563e-04
Loss = 4.3477e-02, PNorm = 432.4225, GNorm = 7.6311, lr_0 = 9.9563e-04
Validation auc = 0.719231
Epoch 6390
Loss = 2.3783e-02, PNorm = 432.4560, GNorm = 0.4768, lr_0 = 9.9563e-04
Validation auc = 0.723062
Epoch 6391
Loss = 9.7604e-03, PNorm = 432.4987, GNorm = 0.0856, lr_0 = 9.9563e-04
Validation auc = 0.723877
Epoch 6392
Loss = 4.3785e-02, PNorm = 432.5313, GNorm = 2.8554, lr_0 = 9.9563e-04
Validation auc = 0.721202
Epoch 6393
Loss = 1.0768e-02, PNorm = 432.5710, GNorm = 0.5594, lr_0 = 9.9563e-04
Validation auc = 0.713406
Epoch 6394
Loss = 4.2946e-02, PNorm = 432.6044, GNorm = 1.4537, lr_0 = 9.9563e-04
Validation auc = 0.715017
Epoch 6395
Loss = 3.5774e-02, PNorm = 432.6391, GNorm = 1.3355, lr_0 = 9.9563e-04
Validation auc = 0.710257
Epoch 6396
Loss = 1.5532e-02, PNorm = 432.6830, GNorm = 0.7298, lr_0 = 9.9563e-04
Validation auc = 0.714187
Epoch 6397
Loss = 1.0362e-02, PNorm = 432.7218, GNorm = 0.3356, lr_0 = 9.9563e-04
Validation auc = 0.715156
Epoch 6398
Loss = 4.1021e-02, PNorm = 432.7502, GNorm = 2.6612, lr_0 = 9.9562e-04
Validation auc = 0.717663
Epoch 6399
Loss = 3.1413e-03, PNorm = 432.7764, GNorm = 0.2044, lr_0 = 9.9562e-04
Loss = 6.5212e-02, PNorm = 432.8064, GNorm = 0.1054, lr_0 = 9.9562e-04
Validation auc = 0.716177
Epoch 6400
Loss = 1.6833e-02, PNorm = 432.8386, GNorm = 0.1261, lr_0 = 9.9562e-04
Validation auc = 0.713937
Epoch 6401
Loss = 1.4060e-02, PNorm = 432.8667, GNorm = 0.4203, lr_0 = 9.9562e-04
Validation auc = 0.720093
Epoch 6402
Loss = 2.3027e-02, PNorm = 432.8903, GNorm = 3.2869, lr_0 = 9.9562e-04
Validation auc = 0.725681
Epoch 6403
Loss = 9.5975e-03, PNorm = 432.9130, GNorm = 0.1302, lr_0 = 9.9562e-04
Validation auc = 0.724101
Epoch 6404
Loss = 5.5164e-02, PNorm = 432.9308, GNorm = 1.5355, lr_0 = 9.9562e-04
Validation auc = 0.712100
Epoch 6405
Loss = 6.5302e-02, PNorm = 432.9538, GNorm = 1.4883, lr_0 = 9.9562e-04
Validation auc = 0.706501
Epoch 6406
Loss = 2.8176e-02, PNorm = 432.9871, GNorm = 1.0204, lr_0 = 9.9562e-04
Validation auc = 0.704870
Epoch 6407
Loss = 3.3586e-02, PNorm = 433.0206, GNorm = 0.4174, lr_0 = 9.9562e-04
Validation auc = 0.705854
Epoch 6408
Loss = 3.4354e-03, PNorm = 433.0542, GNorm = 0.1566, lr_0 = 9.9562e-04
Validation auc = 0.706190
Epoch 6409
Loss = 6.2279e-03, PNorm = 433.0784, GNorm = 0.2048, lr_0 = 9.9562e-04
Loss = 2.1691e-02, PNorm = 433.1040, GNorm = 0.5543, lr_0 = 9.9562e-04
Validation auc = 0.705548
Epoch 6410
Loss = 1.3508e-02, PNorm = 433.1321, GNorm = 0.6221, lr_0 = 9.9561e-04
Validation auc = 0.702023
Epoch 6411
Loss = 1.7957e-02, PNorm = 433.1651, GNorm = 0.0687, lr_0 = 9.9561e-04
Validation auc = 0.704036
Epoch 6412
Loss = 5.8058e-02, PNorm = 433.1934, GNorm = 0.1149, lr_0 = 9.9561e-04
Validation auc = 0.703123
Epoch 6413
Loss = 1.3466e-02, PNorm = 433.2167, GNorm = 0.8604, lr_0 = 9.9561e-04
Validation auc = 0.712678
Epoch 6414
Loss = 1.9741e-02, PNorm = 433.2427, GNorm = 1.3111, lr_0 = 9.9561e-04
Validation auc = 0.726386
Epoch 6415
Loss = 1.3879e-02, PNorm = 433.2668, GNorm = 1.6258, lr_0 = 9.9561e-04
Validation auc = 0.726193
Epoch 6416
Loss = 1.4232e-02, PNorm = 433.2869, GNorm = 0.3674, lr_0 = 9.9561e-04
Validation auc = 0.725306
Epoch 6417
Loss = 9.1020e-03, PNorm = 433.3080, GNorm = 0.0429, lr_0 = 9.9561e-04
Validation auc = 0.715538
Epoch 6418
Loss = 2.6567e-03, PNorm = 433.3290, GNorm = 0.1431, lr_0 = 9.9561e-04
Validation auc = 0.714725
Epoch 6419
Loss = 3.3589e-03, PNorm = 433.3496, GNorm = 0.1440, lr_0 = 9.9561e-04
Loss = 9.0454e-03, PNorm = 433.3733, GNorm = 1.0235, lr_0 = 9.9561e-04
Validation auc = 0.719374
Epoch 6420
Loss = 7.3361e-02, PNorm = 433.4140, GNorm = 3.1388, lr_0 = 9.9561e-04
Validation auc = 0.714327
Epoch 6421
Loss = 2.3292e-02, PNorm = 433.4741, GNorm = 1.7928, lr_0 = 9.9561e-04
Validation auc = 0.719433
Epoch 6422
Loss = 1.4231e-02, PNorm = 433.5156, GNorm = 0.1013, lr_0 = 9.9561e-04
Validation auc = 0.721309
Epoch 6423
Loss = 1.3461e-02, PNorm = 433.5414, GNorm = 0.0637, lr_0 = 9.9561e-04
Validation auc = 0.724048
Epoch 6424
Loss = 3.3570e-02, PNorm = 433.5623, GNorm = 0.4414, lr_0 = 9.9560e-04
Validation auc = 0.717696
Epoch 6425
Loss = 2.0669e-02, PNorm = 433.5914, GNorm = 0.0776, lr_0 = 9.9560e-04
Validation auc = 0.721930
Epoch 6426
Loss = 2.3293e-02, PNorm = 433.6359, GNorm = 0.1181, lr_0 = 9.9560e-04
Validation auc = 0.714622
Epoch 6427
Loss = 5.9188e-03, PNorm = 433.6871, GNorm = 0.0549, lr_0 = 9.9560e-04
Validation auc = 0.710917
Epoch 6428
Loss = 1.8174e-03, PNorm = 433.7408, GNorm = 0.0827, lr_0 = 9.9560e-04
Validation auc = 0.708510
Epoch 6429
Loss = 1.3839e-01, PNorm = 433.7809, GNorm = 3.1391, lr_0 = 9.9560e-04
Loss = 7.2784e-02, PNorm = 433.8435, GNorm = 5.4086, lr_0 = 9.9560e-04
Validation auc = 0.704777
Epoch 6430
Loss = 3.7638e-02, PNorm = 433.9106, GNorm = 0.3690, lr_0 = 9.9560e-04
Validation auc = 0.695529
Epoch 6431
Loss = 2.5464e-02, PNorm = 433.9616, GNorm = 1.7330, lr_0 = 9.9560e-04
Validation auc = 0.692054
Epoch 6432
Loss = 5.6082e-02, PNorm = 434.0037, GNorm = 2.3326, lr_0 = 9.9560e-04
Validation auc = 0.696963
Epoch 6433
Loss = 2.7809e-02, PNorm = 434.0464, GNorm = 0.3095, lr_0 = 9.9560e-04
Validation auc = 0.695976
Epoch 6434
Loss = 3.4479e-02, PNorm = 434.0832, GNorm = 0.2348, lr_0 = 9.9560e-04
Validation auc = 0.698954
Epoch 6435
Loss = 4.6968e-02, PNorm = 434.1261, GNorm = 0.1023, lr_0 = 9.9560e-04
Validation auc = 0.706305
Epoch 6436
Loss = 4.0533e-02, PNorm = 434.1725, GNorm = 0.5817, lr_0 = 9.9560e-04
Validation auc = 0.700748
Epoch 6437
Loss = 3.6318e-02, PNorm = 434.2172, GNorm = 0.4841, lr_0 = 9.9559e-04
Validation auc = 0.695755
Epoch 6438
Loss = 1.1517e-02, PNorm = 434.2483, GNorm = 0.4979, lr_0 = 9.9559e-04
Validation auc = 0.697418
Epoch 6439
Loss = 8.5902e-04, PNorm = 434.2757, GNorm = 0.0338, lr_0 = 9.9559e-04
Loss = 7.6897e-02, PNorm = 434.3200, GNorm = 0.1734, lr_0 = 9.9559e-04
Validation auc = 0.694886
Epoch 6440
Loss = 2.6189e-02, PNorm = 434.3579, GNorm = 0.5177, lr_0 = 9.9559e-04
Validation auc = 0.696053
Epoch 6441
Loss = 3.4988e-02, PNorm = 434.3856, GNorm = 5.3108, lr_0 = 9.9559e-04
Validation auc = 0.704662
Epoch 6442
Loss = 3.0982e-02, PNorm = 434.4218, GNorm = 0.1159, lr_0 = 9.9559e-04
Validation auc = 0.707015
Epoch 6443
Loss = 5.5287e-03, PNorm = 434.4589, GNorm = 0.2936, lr_0 = 9.9559e-04
Validation auc = 0.703360
Epoch 6444
Loss = 2.4308e-02, PNorm = 434.4817, GNorm = 0.7162, lr_0 = 9.9559e-04
Validation auc = 0.707260
Epoch 6445
Loss = 7.2820e-03, PNorm = 434.5030, GNorm = 0.7479, lr_0 = 9.9559e-04
Validation auc = 0.709087
Epoch 6446
Loss = 3.7940e-02, PNorm = 434.5235, GNorm = 0.1020, lr_0 = 9.9559e-04
Validation auc = 0.718468
Epoch 6447
Loss = 1.7256e-02, PNorm = 434.5456, GNorm = 0.1294, lr_0 = 9.9559e-04
Validation auc = 0.726385
Epoch 6448
Loss = 6.1093e-03, PNorm = 434.5662, GNorm = 0.8381, lr_0 = 9.9559e-04
Validation auc = 0.722850
Epoch 6449
Loss = 8.4395e-04, PNorm = 434.5875, GNorm = 0.0802, lr_0 = 9.9559e-04
Loss = 4.0363e-02, PNorm = 434.6096, GNorm = 1.6348, lr_0 = 9.9559e-04
Validation auc = 0.725448
Epoch 6450
Loss = 3.1879e-02, PNorm = 434.6380, GNorm = 1.5257, lr_0 = 9.9558e-04
Validation auc = 0.732708
Epoch 6451
Loss = 2.2322e-02, PNorm = 434.6697, GNorm = 2.0492, lr_0 = 9.9558e-04
Validation auc = 0.732599
Epoch 6452
Loss = 2.0322e-02, PNorm = 434.6941, GNorm = 0.3400, lr_0 = 9.9558e-04
Validation auc = 0.735034
Epoch 6453
Loss = 2.8099e-02, PNorm = 434.7178, GNorm = 2.7895, lr_0 = 9.9558e-04
Validation auc = 0.735541
Epoch 6454
Loss = 1.7753e-02, PNorm = 434.7489, GNorm = 0.5293, lr_0 = 9.9558e-04
Validation auc = 0.730482
Epoch 6455
Loss = 5.4329e-03, PNorm = 434.7758, GNorm = 0.0729, lr_0 = 9.9558e-04
Validation auc = 0.726619
Epoch 6456
Loss = 1.8116e-02, PNorm = 434.8034, GNorm = 0.9030, lr_0 = 9.9558e-04
Validation auc = 0.725707
Epoch 6457
Loss = 1.3408e-02, PNorm = 434.8295, GNorm = 0.0323, lr_0 = 9.9558e-04
Validation auc = 0.728069
Epoch 6458
Loss = 2.1454e-02, PNorm = 434.8489, GNorm = 0.0448, lr_0 = 9.9558e-04
Validation auc = 0.728987
Epoch 6459
Loss = 3.3928e-03, PNorm = 434.8707, GNorm = 0.2163, lr_0 = 9.9558e-04
Loss = 1.1218e-02, PNorm = 434.8992, GNorm = 0.1639, lr_0 = 9.9558e-04
Validation auc = 0.729922
Epoch 6460
Loss = 1.6492e-02, PNorm = 434.9235, GNorm = 0.0173, lr_0 = 9.9558e-04
Validation auc = 0.732504
Epoch 6461
Loss = 1.4616e-02, PNorm = 434.9433, GNorm = 0.0110, lr_0 = 9.9558e-04
Validation auc = 0.734664
Epoch 6462
Loss = 3.1370e-02, PNorm = 434.9630, GNorm = 0.5154, lr_0 = 9.9558e-04
Validation auc = 0.737856
Epoch 6463
Loss = 1.8142e-02, PNorm = 434.9939, GNorm = 1.9038, lr_0 = 9.9558e-04
Validation auc = 0.737650
Epoch 6464
Loss = 1.0519e-02, PNorm = 435.0274, GNorm = 0.6161, lr_0 = 9.9557e-04
Validation auc = 0.739679
Epoch 6465
Loss = 7.0096e-03, PNorm = 435.0603, GNorm = 0.9913, lr_0 = 9.9557e-04
Validation auc = 0.738463
Epoch 6466
Loss = 2.3847e-02, PNorm = 435.0856, GNorm = 1.5871, lr_0 = 9.9557e-04
Validation auc = 0.732607
Epoch 6467
Loss = 3.6799e-03, PNorm = 435.1193, GNorm = 0.0411, lr_0 = 9.9557e-04
Validation auc = 0.728941
Epoch 6468
Loss = 1.3762e-02, PNorm = 435.1617, GNorm = 0.8932, lr_0 = 9.9557e-04
Validation auc = 0.719728
Epoch 6469
Loss = 3.4460e-03, PNorm = 435.2057, GNorm = 0.1629, lr_0 = 9.9557e-04
Loss = 3.6638e-02, PNorm = 435.2472, GNorm = 0.3157, lr_0 = 9.9557e-04
Validation auc = 0.708675
Epoch 6470
Loss = 1.5256e-02, PNorm = 435.2843, GNorm = 1.0444, lr_0 = 9.9557e-04
Validation auc = 0.701712
Epoch 6471
Loss = 1.8381e-02, PNorm = 435.3148, GNorm = 0.8577, lr_0 = 9.9557e-04
Validation auc = 0.705795
Epoch 6472
Loss = 2.5051e-02, PNorm = 435.3385, GNorm = 3.1559, lr_0 = 9.9557e-04
Validation auc = 0.718035
Epoch 6473
Loss = 1.0188e-02, PNorm = 435.3649, GNorm = 0.2441, lr_0 = 9.9557e-04
Validation auc = 0.719856
Epoch 6474
Loss = 1.0972e-02, PNorm = 435.3925, GNorm = 1.0140, lr_0 = 9.9557e-04
Validation auc = 0.716217
Epoch 6475
Loss = 1.0496e-02, PNorm = 435.4143, GNorm = 0.4388, lr_0 = 9.9557e-04
Validation auc = 0.719007
Epoch 6476
Loss = 3.6845e-02, PNorm = 435.4373, GNorm = 5.9795, lr_0 = 9.9557e-04
Validation auc = 0.717922
Epoch 6477
Loss = 5.1107e-02, PNorm = 435.4689, GNorm = 2.4406, lr_0 = 9.9556e-04
Validation auc = 0.708194
Epoch 6478
Loss = 7.0997e-02, PNorm = 435.4975, GNorm = 0.0748, lr_0 = 9.9556e-04
Validation auc = 0.708665
Epoch 6479
Loss = 4.0787e-02, PNorm = 435.5337, GNorm = 1.4819, lr_0 = 9.9556e-04
Loss = 2.2530e-02, PNorm = 435.5788, GNorm = 1.9093, lr_0 = 9.9556e-04
Validation auc = 0.717282
Epoch 6480
Loss = 2.4121e-02, PNorm = 435.6160, GNorm = 2.9723, lr_0 = 9.9556e-04
Validation auc = 0.717384
Epoch 6481
Loss = 3.3368e-02, PNorm = 435.6578, GNorm = 0.1016, lr_0 = 9.9556e-04
Validation auc = 0.721648
Epoch 6482
Loss = 9.9220e-03, PNorm = 435.6939, GNorm = 0.1535, lr_0 = 9.9556e-04
Validation auc = 0.718978
Epoch 6483
Loss = 1.2189e-01, PNorm = 435.7241, GNorm = 0.1366, lr_0 = 9.9556e-04
Validation auc = 0.718636
Epoch 6484
Loss = 1.5444e-02, PNorm = 435.7706, GNorm = 0.5440, lr_0 = 9.9556e-04
Validation auc = 0.714272
Epoch 6485
Loss = 1.8756e-02, PNorm = 435.8110, GNorm = 2.0332, lr_0 = 9.9556e-04
Validation auc = 0.715633
Epoch 6486
Loss = 2.1872e-02, PNorm = 435.8541, GNorm = 1.0811, lr_0 = 9.9556e-04
Validation auc = 0.725151
Epoch 6487
Loss = 5.4846e-02, PNorm = 435.8993, GNorm = 1.7466, lr_0 = 9.9556e-04
Validation auc = 0.730190
Epoch 6488
Loss = 7.7141e-02, PNorm = 435.9418, GNorm = 1.8591, lr_0 = 9.9556e-04
Validation auc = 0.726499
Epoch 6489
Loss = 2.1468e-02, PNorm = 435.9903, GNorm = 0.6648, lr_0 = 9.9556e-04
Loss = 4.4446e-02, PNorm = 436.0541, GNorm = 0.7778, lr_0 = 9.9556e-04
Validation auc = 0.729489
Epoch 6490
Loss = 5.1381e-02, PNorm = 436.1044, GNorm = 0.2388, lr_0 = 9.9555e-04
Validation auc = 0.727724
Epoch 6491
Loss = 1.9973e-02, PNorm = 436.1463, GNorm = 0.7436, lr_0 = 9.9555e-04
Validation auc = 0.728158
Epoch 6492
Loss = 1.2841e-02, PNorm = 436.1828, GNorm = 0.1167, lr_0 = 9.9555e-04
Validation auc = 0.724360
Epoch 6493
Loss = 3.0128e-02, PNorm = 436.2128, GNorm = 3.6696, lr_0 = 9.9555e-04
Validation auc = 0.724536
Epoch 6494
Loss = 3.9002e-02, PNorm = 436.2450, GNorm = 0.1579, lr_0 = 9.9555e-04
Validation auc = 0.722437
Epoch 6495
Loss = 4.6088e-02, PNorm = 436.2761, GNorm = 0.1156, lr_0 = 9.9555e-04
Validation auc = 0.724491
Epoch 6496
Loss = 3.1306e-03, PNorm = 436.3103, GNorm = 0.1926, lr_0 = 9.9555e-04
Validation auc = 0.725544
Epoch 6497
Loss = 3.0669e-02, PNorm = 436.3368, GNorm = 0.1760, lr_0 = 9.9555e-04
Validation auc = 0.724449
Epoch 6498
Loss = 1.3580e-02, PNorm = 436.3633, GNorm = 0.1232, lr_0 = 9.9555e-04
Validation auc = 0.720736
Epoch 6499
Loss = 7.8933e-04, PNorm = 436.3900, GNorm = 0.0433, lr_0 = 9.9555e-04
Loss = 2.8683e-02, PNorm = 436.4294, GNorm = 1.0456, lr_0 = 9.9555e-04
Validation auc = 0.723063
Epoch 6500
Loss = 2.9323e-02, PNorm = 436.4640, GNorm = 0.0370, lr_0 = 9.9555e-04
Validation auc = 0.727833
Epoch 6501
Loss = 9.4983e-02, PNorm = 436.5089, GNorm = 6.8177, lr_0 = 9.9555e-04
Validation auc = 0.732468
Epoch 6502
Loss = 2.5383e-02, PNorm = 436.5584, GNorm = 1.2105, lr_0 = 9.9555e-04
Validation auc = 0.727805
Epoch 6503
Loss = 2.4671e-02, PNorm = 436.5960, GNorm = 0.0319, lr_0 = 9.9554e-04
Validation auc = 0.724457
Epoch 6504
Loss = 1.3915e-02, PNorm = 436.6234, GNorm = 0.4858, lr_0 = 9.9554e-04
Validation auc = 0.724926
Epoch 6505
Loss = 2.7553e-02, PNorm = 436.6495, GNorm = 1.4717, lr_0 = 9.9554e-04
Validation auc = 0.720767
Epoch 6506
Loss = 8.1762e-02, PNorm = 436.6775, GNorm = 0.2471, lr_0 = 9.9554e-04
Validation auc = 0.711892
Epoch 6507
Loss = 3.8105e-03, PNorm = 436.7182, GNorm = 0.0352, lr_0 = 9.9554e-04
Validation auc = 0.702655
Epoch 6508
Loss = 5.1663e-02, PNorm = 436.7549, GNorm = 1.4498, lr_0 = 9.9554e-04
Validation auc = 0.700415
Epoch 6509
Loss = 2.3898e-03, PNorm = 436.7804, GNorm = 0.1523, lr_0 = 9.9554e-04
Loss = 2.7167e-02, PNorm = 436.7981, GNorm = 0.0804, lr_0 = 9.9554e-04
Validation auc = 0.704155
Epoch 6510
Loss = 3.4104e-02, PNorm = 436.8208, GNorm = 0.5296, lr_0 = 9.9554e-04
Validation auc = 0.708797
Epoch 6511
Loss = 4.5174e-02, PNorm = 436.8566, GNorm = 2.1577, lr_0 = 9.9554e-04
Validation auc = 0.717280
Epoch 6512
Loss = 1.7207e-02, PNorm = 436.8992, GNorm = 0.0663, lr_0 = 9.9554e-04
Validation auc = 0.716869
Epoch 6513
Loss = 5.0259e-02, PNorm = 436.9272, GNorm = 0.1607, lr_0 = 9.9554e-04
Validation auc = 0.713979
Epoch 6514
Loss = 5.6813e-02, PNorm = 436.9531, GNorm = 1.2439, lr_0 = 9.9554e-04
Validation auc = 0.710034
Epoch 6515
Loss = 1.6914e-02, PNorm = 436.9870, GNorm = 0.1506, lr_0 = 9.9554e-04
Validation auc = 0.708397
Epoch 6516
Loss = 2.3440e-02, PNorm = 437.0145, GNorm = 0.2121, lr_0 = 9.9554e-04
Validation auc = 0.708325
Epoch 6517
Loss = 1.2434e-02, PNorm = 437.0358, GNorm = 0.0894, lr_0 = 9.9553e-04
Validation auc = 0.705672
Epoch 6518
Loss = 2.2461e-02, PNorm = 437.0540, GNorm = 0.9844, lr_0 = 9.9553e-04
Validation auc = 0.695606
Epoch 6519
Loss = 6.0891e-03, PNorm = 437.0728, GNorm = 0.2057, lr_0 = 9.9553e-04
Loss = 3.8806e-03, PNorm = 437.0914, GNorm = 0.0342, lr_0 = 9.9553e-04
Validation auc = 0.692036
Epoch 6520
Loss = 9.7210e-02, PNorm = 437.1162, GNorm = 2.6007, lr_0 = 9.9553e-04
Validation auc = 0.698369
Epoch 6521
Loss = 1.6840e-02, PNorm = 437.1720, GNorm = 0.4326, lr_0 = 9.9553e-04
Validation auc = 0.705994
Epoch 6522
Loss = 5.9146e-02, PNorm = 437.2203, GNorm = 2.2043, lr_0 = 9.9553e-04
Validation auc = 0.704483
Epoch 6523
Loss = 3.9858e-02, PNorm = 437.2684, GNorm = 1.5470, lr_0 = 9.9553e-04
Validation auc = 0.698850
Epoch 6524
Loss = 1.7396e-02, PNorm = 437.3104, GNorm = 0.2607, lr_0 = 9.9553e-04
Validation auc = 0.692784
Epoch 6525
Loss = 2.6173e-02, PNorm = 437.3458, GNorm = 0.6531, lr_0 = 9.9553e-04
Validation auc = 0.692842
Epoch 6526
Loss = 2.3011e-02, PNorm = 437.3753, GNorm = 1.9723, lr_0 = 9.9553e-04
Validation auc = 0.693616
Epoch 6527
Loss = 3.7907e-02, PNorm = 437.4033, GNorm = 0.3507, lr_0 = 9.9553e-04
Validation auc = 0.690966
Epoch 6528
Loss = 1.0526e-02, PNorm = 437.4292, GNorm = 1.3219, lr_0 = 9.9553e-04
Validation auc = 0.694343
Epoch 6529
Loss = 6.9213e-02, PNorm = 437.4548, GNorm = 2.0503, lr_0 = 9.9553e-04
Loss = 2.3784e-02, PNorm = 437.4896, GNorm = 0.8270, lr_0 = 9.9553e-04
Validation auc = 0.692483
Epoch 6530
Loss = 5.1059e-02, PNorm = 437.5312, GNorm = 1.7778, lr_0 = 9.9552e-04
Validation auc = 0.703133
Epoch 6531
Loss = 1.8439e-02, PNorm = 437.5762, GNorm = 0.0149, lr_0 = 9.9552e-04
Validation auc = 0.708585
Epoch 6532
Loss = 5.8920e-02, PNorm = 437.6121, GNorm = 0.3801, lr_0 = 9.9552e-04
Validation auc = 0.710498
Epoch 6533
Loss = 1.1658e-02, PNorm = 437.6511, GNorm = 1.3712, lr_0 = 9.9552e-04
Validation auc = 0.710671
Epoch 6534
Loss = 1.7617e-02, PNorm = 437.6903, GNorm = 0.9898, lr_0 = 9.9552e-04
Validation auc = 0.711314
Epoch 6535
Loss = 9.5163e-03, PNorm = 437.7200, GNorm = 0.0642, lr_0 = 9.9552e-04
Validation auc = 0.713384
Epoch 6536
Loss = 9.4799e-02, PNorm = 437.7433, GNorm = 3.6650, lr_0 = 9.9552e-04
Validation auc = 0.704730
Epoch 6537
Loss = 3.0149e-02, PNorm = 437.7858, GNorm = 2.0872, lr_0 = 9.9552e-04
Validation auc = 0.709530
Epoch 6538
Loss = 4.2258e-02, PNorm = 437.8311, GNorm = 4.5387, lr_0 = 9.9552e-04
Validation auc = 0.713089
Epoch 6539
Loss = 3.1366e-02, PNorm = 437.8794, GNorm = 1.8193, lr_0 = 9.9552e-04
Loss = 1.4479e-02, PNorm = 437.9190, GNorm = 0.6059, lr_0 = 9.9552e-04
Validation auc = 0.714864
Epoch 6540
Loss = 7.2962e-03, PNorm = 437.9463, GNorm = 0.2295, lr_0 = 9.9552e-04
Validation auc = 0.717409
Epoch 6541
Loss = 9.7045e-03, PNorm = 437.9682, GNorm = 1.1780, lr_0 = 9.9552e-04
Validation auc = 0.719624
Epoch 6542
Loss = 2.8774e-02, PNorm = 437.9890, GNorm = 0.3289, lr_0 = 9.9552e-04
Validation auc = 0.728211
Epoch 6543
Loss = 2.2823e-02, PNorm = 438.0218, GNorm = 1.5612, lr_0 = 9.9551e-04
Validation auc = 0.727849
Epoch 6544
Loss = 1.3494e-02, PNorm = 438.0545, GNorm = 1.3414, lr_0 = 9.9551e-04
Validation auc = 0.728869
Epoch 6545
Loss = 8.3761e-03, PNorm = 438.0863, GNorm = 0.0580, lr_0 = 9.9551e-04
Validation auc = 0.724134
Epoch 6546
Loss = 5.4654e-03, PNorm = 438.1151, GNorm = 0.2674, lr_0 = 9.9551e-04
Validation auc = 0.721360
Epoch 6547
Loss = 6.7073e-03, PNorm = 438.1316, GNorm = 0.4572, lr_0 = 9.9551e-04
Validation auc = 0.727040
Epoch 6548
Loss = 1.0246e-02, PNorm = 438.1474, GNorm = 0.9933, lr_0 = 9.9551e-04
Validation auc = 0.720406
Epoch 6549
Loss = 1.0946e-03, PNorm = 438.1632, GNorm = 0.1236, lr_0 = 9.9551e-04
Loss = 1.5225e-02, PNorm = 438.1820, GNorm = 0.1067, lr_0 = 9.9551e-04
Validation auc = 0.720140
Epoch 6550
Loss = 9.8654e-03, PNorm = 438.2038, GNorm = 0.0691, lr_0 = 9.9551e-04
Validation auc = 0.724052
Epoch 6551
Loss = 3.0684e-02, PNorm = 438.2223, GNorm = 0.5088, lr_0 = 9.9551e-04
Validation auc = 0.725204
Epoch 6552
Loss = 1.8725e-02, PNorm = 438.2433, GNorm = 0.0146, lr_0 = 9.9551e-04
Validation auc = 0.718576
Epoch 6553
Loss = 1.8867e-02, PNorm = 438.2699, GNorm = 1.3622, lr_0 = 9.9551e-04
Validation auc = 0.710190
Epoch 6554
Loss = 2.5850e-02, PNorm = 438.2932, GNorm = 0.6729, lr_0 = 9.9551e-04
Validation auc = 0.706507
Epoch 6555
Loss = 2.3114e-02, PNorm = 438.3191, GNorm = 0.2659, lr_0 = 9.9551e-04
Validation auc = 0.708111
Epoch 6556
Loss = 1.5730e-03, PNorm = 438.3428, GNorm = 0.0306, lr_0 = 9.9551e-04
Validation auc = 0.711670
Epoch 6557
Loss = 5.5556e-03, PNorm = 438.3634, GNorm = 0.9241, lr_0 = 9.9550e-04
Validation auc = 0.708797
Epoch 6558
Loss = 3.5781e-02, PNorm = 438.3861, GNorm = 1.4451, lr_0 = 9.9550e-04
Validation auc = 0.709413
Epoch 6559
Loss = 7.2214e-03, PNorm = 438.4182, GNorm = 0.5140, lr_0 = 9.9550e-04
Loss = 1.9639e-02, PNorm = 438.4573, GNorm = 0.7175, lr_0 = 9.9550e-04
Validation auc = 0.714868
Epoch 6560
Loss = 2.6361e-02, PNorm = 438.4881, GNorm = 0.1812, lr_0 = 9.9550e-04
Validation auc = 0.720644
Epoch 6561
Loss = 3.5843e-02, PNorm = 438.5117, GNorm = 0.3333, lr_0 = 9.9550e-04
Validation auc = 0.720530
Epoch 6562
Loss = 2.7340e-02, PNorm = 438.5359, GNorm = 0.2333, lr_0 = 9.9550e-04
Validation auc = 0.717985
Epoch 6563
Loss = 2.6893e-02, PNorm = 438.5596, GNorm = 2.0880, lr_0 = 9.9550e-04
Validation auc = 0.713601
Epoch 6564
Loss = 7.0407e-02, PNorm = 438.5894, GNorm = 1.3650, lr_0 = 9.9550e-04
Validation auc = 0.708140
Epoch 6565
Loss = 4.5887e-02, PNorm = 438.6262, GNorm = 3.6492, lr_0 = 9.9550e-04
Validation auc = 0.717402
Epoch 6566
Loss = 1.8225e-02, PNorm = 438.6695, GNorm = 0.8850, lr_0 = 9.9550e-04
Validation auc = 0.718629
Epoch 6567
Loss = 1.8274e-03, PNorm = 438.7023, GNorm = 0.1502, lr_0 = 9.9550e-04
Validation auc = 0.719445
Epoch 6568
Loss = 3.1430e-03, PNorm = 438.7322, GNorm = 0.0709, lr_0 = 9.9550e-04
Validation auc = 0.719192
Epoch 6569
Loss = 8.2300e-03, PNorm = 438.7633, GNorm = 0.2597, lr_0 = 9.9550e-04
Loss = 2.6818e-02, PNorm = 438.8024, GNorm = 0.4827, lr_0 = 9.9549e-04
Validation auc = 0.717504
Epoch 6570
Loss = 9.6781e-02, PNorm = 438.8514, GNorm = 1.7790, lr_0 = 9.9549e-04
Validation auc = 0.708705
Epoch 6571
Loss = 4.3946e-02, PNorm = 438.9160, GNorm = 0.7187, lr_0 = 9.9549e-04
Validation auc = 0.711984
Epoch 6572
Loss = 1.5340e-02, PNorm = 438.9623, GNorm = 0.2535, lr_0 = 9.9549e-04
Validation auc = 0.714398
Epoch 6573
Loss = 3.0736e-02, PNorm = 438.9891, GNorm = 0.8678, lr_0 = 9.9549e-04
Validation auc = 0.714691
Epoch 6574
Loss = 1.8133e-02, PNorm = 439.0143, GNorm = 1.1610, lr_0 = 9.9549e-04
Validation auc = 0.708701
Epoch 6575
Loss = 1.1527e-02, PNorm = 439.0362, GNorm = 0.3207, lr_0 = 9.9549e-04
Validation auc = 0.707585
Epoch 6576
Loss = 2.9553e-02, PNorm = 439.0561, GNorm = 0.8527, lr_0 = 9.9549e-04
Validation auc = 0.706616
Epoch 6577
Loss = 3.0062e-02, PNorm = 439.0846, GNorm = 0.3949, lr_0 = 9.9549e-04
Validation auc = 0.714802
Epoch 6578
Loss = 5.5540e-03, PNorm = 439.1212, GNorm = 0.4687, lr_0 = 9.9549e-04
Validation auc = 0.715501
Epoch 6579
Loss = 1.8403e-02, PNorm = 439.1576, GNorm = 0.5940, lr_0 = 9.9549e-04
Loss = 2.3399e-02, PNorm = 439.1908, GNorm = 1.0362, lr_0 = 9.9549e-04
Validation auc = 0.716188
Epoch 6580
Loss = 2.0427e-02, PNorm = 439.2182, GNorm = 0.1789, lr_0 = 9.9549e-04
Validation auc = 0.722222
Epoch 6581
Loss = 2.1262e-02, PNorm = 439.2414, GNorm = 1.9040, lr_0 = 9.9549e-04
Validation auc = 0.731343
Epoch 6582
Loss = 1.4920e-02, PNorm = 439.2685, GNorm = 0.2759, lr_0 = 9.9549e-04
Validation auc = 0.725187
Epoch 6583
Loss = 4.4220e-02, PNorm = 439.3073, GNorm = 0.4664, lr_0 = 9.9548e-04
Validation auc = 0.710298
Epoch 6584
Loss = 4.6930e-02, PNorm = 439.3527, GNorm = 4.7151, lr_0 = 9.9548e-04
Validation auc = 0.703867
Epoch 6585
Loss = 2.4631e-02, PNorm = 439.4044, GNorm = 0.4384, lr_0 = 9.9548e-04
Validation auc = 0.699601
Epoch 6586
Loss = 1.1030e-01, PNorm = 439.4671, GNorm = 3.7684, lr_0 = 9.9548e-04
Validation auc = 0.697967
Epoch 6587
Loss = 1.5510e-02, PNorm = 439.5436, GNorm = 0.5736, lr_0 = 9.9548e-04
Validation auc = 0.701601
Epoch 6588
Loss = 7.6639e-02, PNorm = 439.6118, GNorm = 1.4111, lr_0 = 9.9548e-04
Validation auc = 0.701761
Epoch 6589
Loss = 6.7654e-02, PNorm = 439.6602, GNorm = 1.3676, lr_0 = 9.9548e-04
Loss = 4.0902e-02, PNorm = 439.7072, GNorm = 0.3147, lr_0 = 9.9548e-04
Validation auc = 0.694126
Epoch 6590
Loss = 3.7289e-02, PNorm = 439.7374, GNorm = 0.1237, lr_0 = 9.9548e-04
Validation auc = 0.690319
Epoch 6591
Loss = 1.8830e-02, PNorm = 439.7635, GNorm = 0.2657, lr_0 = 9.9548e-04
Validation auc = 0.688657
Epoch 6592
Loss = 1.8865e-02, PNorm = 439.7851, GNorm = 0.0802, lr_0 = 9.9548e-04
Validation auc = 0.692649
Epoch 6593
Loss = 2.8801e-02, PNorm = 439.8105, GNorm = 0.0917, lr_0 = 9.9548e-04
Validation auc = 0.697758
Epoch 6594
Loss = 3.7457e-02, PNorm = 439.8432, GNorm = 0.0635, lr_0 = 9.9548e-04
Validation auc = 0.698985
Epoch 6595
Loss = 1.9189e-02, PNorm = 439.8759, GNorm = 0.2217, lr_0 = 9.9548e-04
Validation auc = 0.698830
Epoch 6596
Loss = 2.6470e-02, PNorm = 439.9033, GNorm = 1.0455, lr_0 = 9.9548e-04
Validation auc = 0.704692
Epoch 6597
Loss = 1.1817e-02, PNorm = 439.9301, GNorm = 0.5246, lr_0 = 9.9547e-04
Validation auc = 0.706909
Epoch 6598
Loss = 2.0576e-01, PNorm = 439.9540, GNorm = 3.2659, lr_0 = 9.9547e-04
Validation auc = 0.709442
Epoch 6599
Loss = 5.2897e-03, PNorm = 439.9813, GNorm = 0.1772, lr_0 = 9.9547e-04
Loss = 1.3481e-02, PNorm = 440.0067, GNorm = 0.0566, lr_0 = 9.9547e-04
Validation auc = 0.706584
Epoch 6600
Loss = 1.6599e-02, PNorm = 440.0245, GNorm = 0.4344, lr_0 = 9.9547e-04
Validation auc = 0.706884
Epoch 6601
Loss = 7.0700e-02, PNorm = 440.0527, GNorm = 2.3368, lr_0 = 9.9547e-04
Validation auc = 0.694244
Epoch 6602
Loss = 2.2803e-02, PNorm = 440.0916, GNorm = 0.2009, lr_0 = 9.9547e-04
Validation auc = 0.689194
Epoch 6603
Loss = 2.2416e-02, PNorm = 440.1246, GNorm = 0.2191, lr_0 = 9.9547e-04
Validation auc = 0.693915
Epoch 6604
Loss = 1.7500e-02, PNorm = 440.1487, GNorm = 0.8911, lr_0 = 9.9547e-04
Validation auc = 0.694634
Epoch 6605
Loss = 4.7088e-02, PNorm = 440.1675, GNorm = 2.4283, lr_0 = 9.9547e-04
Validation auc = 0.694621
Epoch 6606
Loss = 4.7211e-02, PNorm = 440.2061, GNorm = 1.6897, lr_0 = 9.9547e-04
Validation auc = 0.686309
Epoch 6607
Loss = 6.1658e-03, PNorm = 440.2381, GNorm = 0.0580, lr_0 = 9.9547e-04
Validation auc = 0.684078
Epoch 6608
Loss = 6.2994e-03, PNorm = 440.2618, GNorm = 0.1061, lr_0 = 9.9547e-04
Validation auc = 0.688413
Epoch 6609
Loss = 3.0252e-02, PNorm = 440.2849, GNorm = 1.1668, lr_0 = 9.9547e-04
Loss = 2.1831e-02, PNorm = 440.3095, GNorm = 2.8522, lr_0 = 9.9546e-04
Validation auc = 0.686819
Epoch 6610
Loss = 1.8872e-02, PNorm = 440.3360, GNorm = 0.1635, lr_0 = 9.9546e-04
Validation auc = 0.683433
Epoch 6611
Loss = 2.3067e-02, PNorm = 440.3615, GNorm = 1.6292, lr_0 = 9.9546e-04
Validation auc = 0.679730
Epoch 6612
Loss = 4.8118e-03, PNorm = 440.3816, GNorm = 0.1377, lr_0 = 9.9546e-04
Validation auc = 0.679247
Epoch 6613
Loss = 1.3954e-02, PNorm = 440.4016, GNorm = 3.0410, lr_0 = 9.9546e-04
Validation auc = 0.683919
Epoch 6614
Loss = 2.7441e-02, PNorm = 440.4232, GNorm = 0.0438, lr_0 = 9.9546e-04
Validation auc = 0.678381
Epoch 6615
Loss = 1.2577e-02, PNorm = 440.4418, GNorm = 0.0953, lr_0 = 9.9546e-04
Validation auc = 0.685750
Epoch 6616
Loss = 3.1187e-02, PNorm = 440.4604, GNorm = 0.1869, lr_0 = 9.9546e-04
Validation auc = 0.680193
Epoch 6617
Loss = 1.1088e-02, PNorm = 440.4805, GNorm = 1.1932, lr_0 = 9.9546e-04
Validation auc = 0.680908
Epoch 6618
Loss = 1.2581e-02, PNorm = 440.5182, GNorm = 0.2349, lr_0 = 9.9546e-04
Validation auc = 0.687592
Epoch 6619
Loss = 2.4764e-02, PNorm = 440.5650, GNorm = 0.6901, lr_0 = 9.9546e-04
Loss = 2.1587e-02, PNorm = 440.5938, GNorm = 0.1296, lr_0 = 9.9546e-04
Validation auc = 0.687426
Epoch 6620
Loss = 2.3579e-02, PNorm = 440.6207, GNorm = 0.0382, lr_0 = 9.9546e-04
Validation auc = 0.693858
Epoch 6621
Loss = 9.8578e-03, PNorm = 440.6456, GNorm = 0.0168, lr_0 = 9.9546e-04
Validation auc = 0.695491
Epoch 6622
Loss = 1.9188e-02, PNorm = 440.6636, GNorm = 0.1454, lr_0 = 9.9546e-04
Validation auc = 0.699105
Epoch 6623
Loss = 1.2522e-02, PNorm = 440.6811, GNorm = 0.1297, lr_0 = 9.9545e-04
Validation auc = 0.697460
Epoch 6624
Loss = 1.5418e-02, PNorm = 440.6984, GNorm = 0.1956, lr_0 = 9.9545e-04
Validation auc = 0.700991
Epoch 6625
Loss = 4.7624e-03, PNorm = 440.7148, GNorm = 0.0236, lr_0 = 9.9545e-04
Validation auc = 0.694559
Epoch 6626
Loss = 5.6872e-03, PNorm = 440.7279, GNorm = 0.8452, lr_0 = 9.9545e-04
Validation auc = 0.697603
Epoch 6627
Loss = 3.3114e-02, PNorm = 440.7373, GNorm = 1.3987, lr_0 = 9.9545e-04
Validation auc = 0.690405
Epoch 6628
Loss = 3.2022e-02, PNorm = 440.7523, GNorm = 5.6401, lr_0 = 9.9545e-04
Validation auc = 0.694658
Epoch 6629
Loss = 2.3644e-03, PNorm = 440.7856, GNorm = 0.1006, lr_0 = 9.9545e-04
Loss = 3.3079e-02, PNorm = 440.8195, GNorm = 2.6986, lr_0 = 9.9545e-04
Validation auc = 0.699641
Epoch 6630
Loss = 2.0214e-02, PNorm = 440.8540, GNorm = 0.9578, lr_0 = 9.9545e-04
Validation auc = 0.700058
Epoch 6631
Loss = 2.1587e-02, PNorm = 440.8915, GNorm = 0.1980, lr_0 = 9.9545e-04
Validation auc = 0.701382
Epoch 6632
Loss = 2.8066e-02, PNorm = 440.9240, GNorm = 0.0273, lr_0 = 9.9545e-04
Validation auc = 0.704340
Epoch 6633
Loss = 3.0203e-02, PNorm = 440.9483, GNorm = 1.5658, lr_0 = 9.9545e-04
Validation auc = 0.697843
Epoch 6634
Loss = 1.0850e-02, PNorm = 440.9778, GNorm = 0.0838, lr_0 = 9.9545e-04
Validation auc = 0.695152
Epoch 6635
Loss = 7.5520e-03, PNorm = 441.0021, GNorm = 0.1782, lr_0 = 9.9545e-04
Validation auc = 0.704055
Epoch 6636
Loss = 4.6125e-03, PNorm = 441.0199, GNorm = 0.1176, lr_0 = 9.9544e-04
Validation auc = 0.706084
Epoch 6637
Loss = 3.2260e-03, PNorm = 441.0445, GNorm = 0.1406, lr_0 = 9.9544e-04
Validation auc = 0.699071
Epoch 6638
Loss = 7.0477e-03, PNorm = 441.0664, GNorm = 0.7313, lr_0 = 9.9544e-04
Validation auc = 0.701816
Epoch 6639
Loss = 5.4043e-03, PNorm = 441.0881, GNorm = 0.2774, lr_0 = 9.9544e-04
Loss = 5.0168e-02, PNorm = 441.1139, GNorm = 0.8855, lr_0 = 9.9544e-04
Validation auc = 0.693483
Epoch 6640
Loss = 6.5513e-03, PNorm = 441.1414, GNorm = 0.1270, lr_0 = 9.9544e-04
Validation auc = 0.686419
Epoch 6641
Loss = 3.4212e-02, PNorm = 441.1660, GNorm = 2.1870, lr_0 = 9.9544e-04
Validation auc = 0.692767
Epoch 6642
Loss = 2.0920e-02, PNorm = 441.2000, GNorm = 0.1085, lr_0 = 9.9544e-04
Validation auc = 0.701346
Epoch 6643
Loss = 2.5189e-02, PNorm = 441.2298, GNorm = 1.0242, lr_0 = 9.9544e-04
Validation auc = 0.699207
Epoch 6644
Loss = 1.7200e-02, PNorm = 441.2531, GNorm = 0.3299, lr_0 = 9.9544e-04
Validation auc = 0.697572
Epoch 6645
Loss = 2.3160e-02, PNorm = 441.2784, GNorm = 2.0228, lr_0 = 9.9544e-04
Validation auc = 0.693256
Epoch 6646
Loss = 4.6246e-03, PNorm = 441.3086, GNorm = 0.0267, lr_0 = 9.9544e-04
Validation auc = 0.687978
Epoch 6647
Loss = 2.9434e-03, PNorm = 441.3369, GNorm = 0.1086, lr_0 = 9.9544e-04
Validation auc = 0.690877
Epoch 6648
Loss = 1.6702e-02, PNorm = 441.3651, GNorm = 0.0421, lr_0 = 9.9544e-04
Validation auc = 0.688664
Epoch 6649
Loss = 4.7337e-03, PNorm = 441.3963, GNorm = 0.1253, lr_0 = 9.9544e-04
Loss = 1.3198e-02, PNorm = 441.4303, GNorm = 0.1353, lr_0 = 9.9543e-04
Validation auc = 0.683988
Epoch 6650
Loss = 2.2300e-02, PNorm = 441.4598, GNorm = 0.0728, lr_0 = 9.9543e-04
Validation auc = 0.683573
Epoch 6651
Loss = 1.9772e-02, PNorm = 441.4860, GNorm = 0.1325, lr_0 = 9.9543e-04
Validation auc = 0.684676
Epoch 6652
Loss = 1.4771e-02, PNorm = 441.5057, GNorm = 0.0813, lr_0 = 9.9543e-04
Validation auc = 0.680042
Epoch 6653
Loss = 1.5460e-02, PNorm = 441.5261, GNorm = 0.0587, lr_0 = 9.9543e-04
Validation auc = 0.687484
Epoch 6654
Loss = 1.7942e-02, PNorm = 441.5494, GNorm = 1.0893, lr_0 = 9.9543e-04
Validation auc = 0.691682
Epoch 6655
Loss = 1.1634e-01, PNorm = 441.5713, GNorm = 0.0803, lr_0 = 9.9543e-04
Validation auc = 0.685509
Epoch 6656
Loss = 1.0744e-02, PNorm = 441.5975, GNorm = 0.1638, lr_0 = 9.9543e-04
Validation auc = 0.688462
Epoch 6657
Loss = 1.0942e-02, PNorm = 441.6234, GNorm = 0.5354, lr_0 = 9.9543e-04
Validation auc = 0.687535
Epoch 6658
Loss = 2.1834e-02, PNorm = 441.6445, GNorm = 2.5922, lr_0 = 9.9543e-04
Validation auc = 0.691575
Epoch 6659
Loss = 2.7865e-03, PNorm = 441.6913, GNorm = 0.0894, lr_0 = 9.9543e-04
Loss = 5.1069e-02, PNorm = 441.7724, GNorm = 0.8433, lr_0 = 9.9543e-04
Validation auc = 0.703250
Epoch 6660
Loss = 2.5709e-02, PNorm = 441.8237, GNorm = 1.0867, lr_0 = 9.9543e-04
Validation auc = 0.703865
Epoch 6661
Loss = 4.4703e-02, PNorm = 441.8606, GNorm = 0.1250, lr_0 = 9.9543e-04
Validation auc = 0.703058
Epoch 6662
Loss = 2.8636e-02, PNorm = 441.8999, GNorm = 0.2020, lr_0 = 9.9542e-04
Validation auc = 0.707200
Epoch 6663
Loss = 2.2221e-02, PNorm = 441.9410, GNorm = 1.1168, lr_0 = 9.9542e-04
Validation auc = 0.710403
Epoch 6664
Loss = 2.9014e-02, PNorm = 441.9790, GNorm = 0.1015, lr_0 = 9.9542e-04
Validation auc = 0.713385
Epoch 6665
Loss = 1.6519e-03, PNorm = 442.0163, GNorm = 0.0534, lr_0 = 9.9542e-04
Validation auc = 0.710771
Epoch 6666
Loss = 5.9951e-02, PNorm = 442.0523, GNorm = 0.6764, lr_0 = 9.9542e-04
Validation auc = 0.715053
Epoch 6667
Loss = 1.6159e-02, PNorm = 442.0877, GNorm = 1.3163, lr_0 = 9.9542e-04
Validation auc = 0.715042
Epoch 6668
Loss = 1.4045e-02, PNorm = 442.1232, GNorm = 0.4427, lr_0 = 9.9542e-04
Validation auc = 0.712400
Epoch 6669
Loss = 6.4233e-04, PNorm = 442.1591, GNorm = 0.0301, lr_0 = 9.9542e-04
Loss = 1.1600e-02, PNorm = 442.1917, GNorm = 0.9748, lr_0 = 9.9542e-04
Validation auc = 0.708490
Epoch 6670
Loss = 2.7194e-02, PNorm = 442.2200, GNorm = 0.0694, lr_0 = 9.9542e-04
Validation auc = 0.711939
Epoch 6671
Loss = 1.1089e-02, PNorm = 442.2406, GNorm = 0.0582, lr_0 = 9.9542e-04
Validation auc = 0.709459
Epoch 6672
Loss = 1.2726e-02, PNorm = 442.2662, GNorm = 1.0954, lr_0 = 9.9542e-04
Validation auc = 0.706821
Epoch 6673
Loss = 6.7238e-03, PNorm = 442.2942, GNorm = 0.2507, lr_0 = 9.9542e-04
Validation auc = 0.712477
Epoch 6674
Loss = 6.9809e-03, PNorm = 442.3206, GNorm = 0.9608, lr_0 = 9.9542e-04
Validation auc = 0.713268
Epoch 6675
Loss = 5.3746e-02, PNorm = 442.3565, GNorm = 2.1215, lr_0 = 9.9542e-04
Validation auc = 0.704335
Epoch 6676
Loss = 4.3998e-02, PNorm = 442.4207, GNorm = 0.7386, lr_0 = 9.9541e-04
Validation auc = 0.706106
Epoch 6677
Loss = 4.6387e-02, PNorm = 442.4707, GNorm = 0.2411, lr_0 = 9.9541e-04
Validation auc = 0.711010
Epoch 6678
Loss = 6.9959e-03, PNorm = 442.5119, GNorm = 0.6851, lr_0 = 9.9541e-04
Validation auc = 0.714349
Epoch 6679
Loss = 4.3803e-03, PNorm = 442.5554, GNorm = 0.1248, lr_0 = 9.9541e-04
Loss = 4.3335e-03, PNorm = 442.5808, GNorm = 0.2257, lr_0 = 9.9541e-04
Validation auc = 0.711320
Epoch 6680
Loss = 1.5596e-02, PNorm = 442.6004, GNorm = 2.6101, lr_0 = 9.9541e-04
Validation auc = 0.706410
Epoch 6681
Loss = 1.7337e-02, PNorm = 442.6258, GNorm = 0.8940, lr_0 = 9.9541e-04
Validation auc = 0.701654
Epoch 6682
Loss = 2.9837e-02, PNorm = 442.6593, GNorm = 0.2679, lr_0 = 9.9541e-04
Validation auc = 0.703263
Epoch 6683
Loss = 1.7363e-02, PNorm = 442.6949, GNorm = 0.0764, lr_0 = 9.9541e-04
Validation auc = 0.703669
Epoch 6684
Loss = 4.6128e-02, PNorm = 442.7269, GNorm = 2.9850, lr_0 = 9.9541e-04
Validation auc = 0.704217
Epoch 6685
Loss = 5.0637e-02, PNorm = 442.7566, GNorm = 2.8701, lr_0 = 9.9541e-04
Validation auc = 0.703891
Epoch 6686
Loss = 6.6883e-02, PNorm = 442.7863, GNorm = 0.3627, lr_0 = 9.9541e-04
Validation auc = 0.705686
Epoch 6687
Loss = 3.4026e-02, PNorm = 442.8192, GNorm = 1.6076, lr_0 = 9.9541e-04
Validation auc = 0.710243
Epoch 6688
Loss = 4.4393e-02, PNorm = 442.8467, GNorm = 2.0377, lr_0 = 9.9541e-04
Validation auc = 0.712727
Epoch 6689
Loss = 6.8316e-02, PNorm = 442.8801, GNorm = 1.0057, lr_0 = 9.9541e-04
Loss = 2.9702e-02, PNorm = 442.9171, GNorm = 0.6125, lr_0 = 9.9540e-04
Validation auc = 0.707458
Epoch 6690
Loss = 1.5514e-02, PNorm = 442.9493, GNorm = 0.0712, lr_0 = 9.9540e-04
Validation auc = 0.702605
Epoch 6691
Loss = 1.5004e-02, PNorm = 442.9756, GNorm = 3.2259, lr_0 = 9.9540e-04
Validation auc = 0.702229
Epoch 6692
Loss = 4.8236e-02, PNorm = 443.0078, GNorm = 0.0655, lr_0 = 9.9540e-04
Validation auc = 0.697589
Epoch 6693
Loss = 1.8748e-02, PNorm = 443.0450, GNorm = 0.0237, lr_0 = 9.9540e-04
Validation auc = 0.694539
Epoch 6694
Loss = 1.7303e-02, PNorm = 443.0722, GNorm = 0.0515, lr_0 = 9.9540e-04
Validation auc = 0.698145
Epoch 6695
Loss = 1.1756e-02, PNorm = 443.0981, GNorm = 0.1052, lr_0 = 9.9540e-04
Validation auc = 0.704879
Epoch 6696
Loss = 7.0671e-02, PNorm = 443.1255, GNorm = 2.7759, lr_0 = 9.9540e-04
Validation auc = 0.703162
Epoch 6697
Loss = 7.9177e-03, PNorm = 443.1524, GNorm = 0.2031, lr_0 = 9.9540e-04
Validation auc = 0.700189
Epoch 6698
Loss = 1.2295e-02, PNorm = 443.1776, GNorm = 1.1235, lr_0 = 9.9540e-04
Validation auc = 0.699534
Epoch 6699
Loss = 6.4625e-04, PNorm = 443.1995, GNorm = 0.0307, lr_0 = 9.9540e-04
Loss = 2.7027e-02, PNorm = 443.2182, GNorm = 1.1310, lr_0 = 9.9540e-04
Validation auc = 0.697437
Epoch 6700
Loss = 1.4039e-02, PNorm = 443.2434, GNorm = 0.0574, lr_0 = 9.9540e-04
Validation auc = 0.700256
Epoch 6701
Loss = 1.8592e-02, PNorm = 443.2720, GNorm = 1.4672, lr_0 = 9.9540e-04
Validation auc = 0.697856
Epoch 6702
Loss = 2.1518e-02, PNorm = 443.2970, GNorm = 0.7906, lr_0 = 9.9539e-04
Validation auc = 0.698803
Epoch 6703
Loss = 3.3035e-03, PNorm = 443.3192, GNorm = 0.1051, lr_0 = 9.9539e-04
Validation auc = 0.701666
Epoch 6704
Loss = 6.6930e-02, PNorm = 443.3454, GNorm = 3.0161, lr_0 = 9.9539e-04
Validation auc = 0.703345
Epoch 6705
Loss = 2.6053e-02, PNorm = 443.3866, GNorm = 0.3184, lr_0 = 9.9539e-04
Validation auc = 0.701894
Epoch 6706
Loss = 5.8686e-02, PNorm = 443.4242, GNorm = 0.9645, lr_0 = 9.9539e-04
Validation auc = 0.701240
Epoch 6707
Loss = 3.6649e-03, PNorm = 443.4562, GNorm = 0.0946, lr_0 = 9.9539e-04
Validation auc = 0.705537
Epoch 6708
Loss = 5.9754e-03, PNorm = 443.4889, GNorm = 0.4149, lr_0 = 9.9539e-04
Validation auc = 0.712995
Epoch 6709
Loss = 3.6045e-02, PNorm = 443.5236, GNorm = 1.1613, lr_0 = 9.9539e-04
Loss = 3.6752e-02, PNorm = 443.5488, GNorm = 0.4927, lr_0 = 9.9539e-04
Validation auc = 0.713514
Epoch 6710
Loss = 4.9421e-02, PNorm = 443.5775, GNorm = 6.0499, lr_0 = 9.9539e-04
Validation auc = 0.718489
Epoch 6711
Loss = 2.5673e-02, PNorm = 443.6075, GNorm = 0.3815, lr_0 = 9.9539e-04
Validation auc = 0.723636
Epoch 6712
Loss = 1.8563e-02, PNorm = 443.6303, GNorm = 0.6059, lr_0 = 9.9539e-04
Validation auc = 0.725684
Epoch 6713
Loss = 4.4636e-02, PNorm = 443.6474, GNorm = 2.2801, lr_0 = 9.9539e-04
Validation auc = 0.727205
Epoch 6714
Loss = 2.2142e-02, PNorm = 443.6695, GNorm = 1.4012, lr_0 = 9.9539e-04
Validation auc = 0.726521
Epoch 6715
Loss = 3.1019e-02, PNorm = 443.6958, GNorm = 0.1244, lr_0 = 9.9539e-04
Validation auc = 0.729798
Epoch 6716
Loss = 5.5489e-02, PNorm = 443.7227, GNorm = 1.5892, lr_0 = 9.9538e-04
Validation auc = 0.737672
Epoch 6717
Loss = 8.9781e-03, PNorm = 443.7521, GNorm = 0.0373, lr_0 = 9.9538e-04
Validation auc = 0.738507
Epoch 6718
Loss = 6.3784e-02, PNorm = 443.7837, GNorm = 0.8854, lr_0 = 9.9538e-04
Validation auc = 0.736335
Epoch 6719
Loss = 8.3006e-04, PNorm = 443.8193, GNorm = 0.0348, lr_0 = 9.9538e-04
Loss = 2.3388e-02, PNorm = 443.8501, GNorm = 0.0752, lr_0 = 9.9538e-04
Validation auc = 0.735671
Epoch 6720
Loss = 4.8742e-02, PNorm = 443.8780, GNorm = 4.8483, lr_0 = 9.9538e-04
Validation auc = 0.737330
Epoch 6721
Loss = 3.0047e-02, PNorm = 443.9223, GNorm = 0.0324, lr_0 = 9.9538e-04
Validation auc = 0.730087
Epoch 6722
Loss = 5.9992e-02, PNorm = 443.9627, GNorm = 0.0695, lr_0 = 9.9538e-04
Validation auc = 0.720927
Epoch 6723
Loss = 2.3486e-02, PNorm = 444.0005, GNorm = 1.1444, lr_0 = 9.9538e-04
Validation auc = 0.712872
Epoch 6724
Loss = 2.3668e-02, PNorm = 444.0436, GNorm = 0.9025, lr_0 = 9.9538e-04
Validation auc = 0.710649
Epoch 6725
Loss = 7.7286e-02, PNorm = 444.0900, GNorm = 0.8241, lr_0 = 9.9538e-04
Validation auc = 0.713389
Epoch 6726
Loss = 5.8423e-02, PNorm = 444.1531, GNorm = 2.6241, lr_0 = 9.9538e-04
Validation auc = 0.720089
Epoch 6727
Loss = 1.7338e-02, PNorm = 444.2044, GNorm = 0.8158, lr_0 = 9.9538e-04
Validation auc = 0.726480
Epoch 6728
Loss = 1.4855e-02, PNorm = 444.2427, GNorm = 0.1997, lr_0 = 9.9538e-04
Validation auc = 0.731579
Epoch 6729
Loss = 7.7119e-04, PNorm = 444.2717, GNorm = 0.0295, lr_0 = 9.9537e-04
Loss = 3.5462e-02, PNorm = 444.2961, GNorm = 0.0970, lr_0 = 9.9537e-04
Validation auc = 0.733955
Epoch 6730
Loss = 5.9461e-02, PNorm = 444.3321, GNorm = 0.2036, lr_0 = 9.9537e-04
Validation auc = 0.732405
Epoch 6731
Loss = 2.8403e-02, PNorm = 444.3673, GNorm = 2.1820, lr_0 = 9.9537e-04
Validation auc = 0.734719
Epoch 6732
Loss = 1.8083e-02, PNorm = 444.3999, GNorm = 0.8480, lr_0 = 9.9537e-04
Validation auc = 0.733767
Epoch 6733
Loss = 4.8537e-03, PNorm = 444.4265, GNorm = 0.0913, lr_0 = 9.9537e-04
Validation auc = 0.733973
Epoch 6734
Loss = 1.0701e-02, PNorm = 444.4470, GNorm = 0.0920, lr_0 = 9.9537e-04
Validation auc = 0.733469
Epoch 6735
Loss = 5.7753e-03, PNorm = 444.4630, GNorm = 0.0281, lr_0 = 9.9537e-04
Validation auc = 0.726551
Epoch 6736
Loss = 8.2981e-03, PNorm = 444.4860, GNorm = 0.2262, lr_0 = 9.9537e-04
Validation auc = 0.721030
Epoch 6737
Loss = 3.8233e-03, PNorm = 444.5145, GNorm = 0.0810, lr_0 = 9.9537e-04
Validation auc = 0.722146
Epoch 6738
Loss = 4.9218e-02, PNorm = 444.5387, GNorm = 0.8649, lr_0 = 9.9537e-04
Validation auc = 0.721317
Epoch 6739
Loss = 1.8958e-03, PNorm = 444.5624, GNorm = 0.0802, lr_0 = 9.9537e-04
Loss = 1.6464e-02, PNorm = 444.5847, GNorm = 0.7229, lr_0 = 9.9537e-04
Validation auc = 0.721985
Epoch 6740
Loss = 1.6471e-02, PNorm = 444.6122, GNorm = 0.0685, lr_0 = 9.9537e-04
Validation auc = 0.721018
Epoch 6741
Loss = 2.5434e-02, PNorm = 444.6347, GNorm = 2.0048, lr_0 = 9.9537e-04
Validation auc = 0.722526
Epoch 6742
Loss = 3.8425e-02, PNorm = 444.6514, GNorm = 10.4632, lr_0 = 9.9536e-04
Validation auc = 0.726677
Epoch 6743
Loss = 5.0445e-02, PNorm = 444.6796, GNorm = 1.5583, lr_0 = 9.9536e-04
Validation auc = 0.722766
Epoch 6744
Loss = 1.4496e-02, PNorm = 444.7121, GNorm = 1.7169, lr_0 = 9.9536e-04
Validation auc = 0.716374
Epoch 6745
Loss = 5.7433e-03, PNorm = 444.7455, GNorm = 0.2318, lr_0 = 9.9536e-04
Validation auc = 0.713340
Epoch 6746
Loss = 1.5251e-02, PNorm = 444.7735, GNorm = 0.6546, lr_0 = 9.9536e-04
Validation auc = 0.711157
Epoch 6747
Loss = 5.1277e-02, PNorm = 444.8018, GNorm = 3.3018, lr_0 = 9.9536e-04
Validation auc = 0.711256
Epoch 6748
Loss = 5.0094e-02, PNorm = 444.8318, GNorm = 6.6741, lr_0 = 9.9536e-04
Validation auc = 0.725101
Epoch 6749
Loss = 6.0355e-03, PNorm = 444.8686, GNorm = 0.2681, lr_0 = 9.9536e-04
Loss = 2.0957e-02, PNorm = 444.8955, GNorm = 0.0982, lr_0 = 9.9536e-04
Validation auc = 0.725647
Epoch 6750
Loss = 1.4784e-02, PNorm = 444.9157, GNorm = 0.1289, lr_0 = 9.9536e-04
Validation auc = 0.730750
Epoch 6751
Loss = 1.2723e-02, PNorm = 444.9348, GNorm = 0.1516, lr_0 = 9.9536e-04
Validation auc = 0.728040
Epoch 6752
Loss = 8.3057e-02, PNorm = 444.9538, GNorm = 1.9245, lr_0 = 9.9536e-04
Validation auc = 0.726449
Epoch 6753
Loss = 5.9181e-02, PNorm = 444.9775, GNorm = 6.8616, lr_0 = 9.9536e-04
Validation auc = 0.726021
Epoch 6754
Loss = 2.9499e-02, PNorm = 445.0232, GNorm = 1.7440, lr_0 = 9.9536e-04
Validation auc = 0.721420
Epoch 6755
Loss = 3.9418e-02, PNorm = 445.0614, GNorm = 1.6468, lr_0 = 9.9536e-04
Validation auc = 0.723343
Epoch 6756
Loss = 2.3955e-02, PNorm = 445.0990, GNorm = 2.0018, lr_0 = 9.9535e-04
Validation auc = 0.727135
Epoch 6757
Loss = 1.6561e-02, PNorm = 445.1397, GNorm = 1.0917, lr_0 = 9.9535e-04
Validation auc = 0.726967
Epoch 6758
Loss = 6.1748e-02, PNorm = 445.1749, GNorm = 1.7112, lr_0 = 9.9535e-04
Validation auc = 0.730067
Epoch 6759
Loss = 1.3530e-01, PNorm = 445.2096, GNorm = 1.6275, lr_0 = 9.9535e-04
Loss = 2.4288e-02, PNorm = 445.2380, GNorm = 1.5602, lr_0 = 9.9535e-04
Validation auc = 0.729083
Epoch 6760
Loss = 8.2228e-02, PNorm = 445.2816, GNorm = 0.6554, lr_0 = 9.9535e-04
Validation auc = 0.720243
Epoch 6761
Loss = 2.4121e-02, PNorm = 445.3379, GNorm = 1.0024, lr_0 = 9.9535e-04
Validation auc = 0.721413
Epoch 6762
Loss = 2.8533e-02, PNorm = 445.3908, GNorm = 1.6704, lr_0 = 9.9535e-04
Validation auc = 0.721943
Epoch 6763
Loss = 2.2657e-02, PNorm = 445.4421, GNorm = 2.3407, lr_0 = 9.9535e-04
Validation auc = 0.719961
Epoch 6764
Loss = 3.4307e-02, PNorm = 445.4848, GNorm = 0.1183, lr_0 = 9.9535e-04
Validation auc = 0.723778
Epoch 6765
Loss = 1.2562e-02, PNorm = 445.5220, GNorm = 0.1374, lr_0 = 9.9535e-04
Validation auc = 0.725230
Epoch 6766
Loss = 3.8146e-02, PNorm = 445.5493, GNorm = 0.2984, lr_0 = 9.9535e-04
Validation auc = 0.727152
Epoch 6767
Loss = 1.3699e-02, PNorm = 445.5711, GNorm = 0.1405, lr_0 = 9.9535e-04
Validation auc = 0.729704
Epoch 6768
Loss = 1.0623e-02, PNorm = 445.5944, GNorm = 1.2206, lr_0 = 9.9535e-04
Validation auc = 0.732254
Epoch 6769
Loss = 1.5498e-01, PNorm = 445.6261, GNorm = 2.4707, lr_0 = 9.9534e-04
Loss = 3.8953e-02, PNorm = 445.6722, GNorm = 1.3401, lr_0 = 9.9534e-04
Validation auc = 0.726844
Epoch 6770
Loss = 4.9522e-03, PNorm = 445.7241, GNorm = 0.1261, lr_0 = 9.9534e-04
Validation auc = 0.729264
Epoch 6771
Loss = 2.6881e-02, PNorm = 445.7558, GNorm = 0.8224, lr_0 = 9.9534e-04
Validation auc = 0.727204
Epoch 6772
Loss = 1.4201e-02, PNorm = 445.7853, GNorm = 0.1530, lr_0 = 9.9534e-04
Validation auc = 0.724914
Epoch 6773
Loss = 1.0124e-02, PNorm = 445.8099, GNorm = 0.2012, lr_0 = 9.9534e-04
Validation auc = 0.726574
Epoch 6774
Loss = 7.4063e-03, PNorm = 445.8308, GNorm = 0.3755, lr_0 = 9.9534e-04
Validation auc = 0.727742
Epoch 6775
Loss = 7.2953e-02, PNorm = 445.8594, GNorm = 0.2139, lr_0 = 9.9534e-04
Validation auc = 0.727587
Epoch 6776
Loss = 4.2904e-03, PNorm = 445.8993, GNorm = 0.0116, lr_0 = 9.9534e-04
Validation auc = 0.728463
Epoch 6777
Loss = 4.7832e-03, PNorm = 445.9226, GNorm = 0.7962, lr_0 = 9.9534e-04
Validation auc = 0.733970
Epoch 6778
Loss = 1.0354e-02, PNorm = 445.9501, GNorm = 1.8872, lr_0 = 9.9534e-04
Validation auc = 0.732071
Epoch 6779
Loss = 6.8204e-02, PNorm = 445.9810, GNorm = 1.1020, lr_0 = 9.9534e-04
Loss = 2.1105e-02, PNorm = 446.0098, GNorm = 0.1703, lr_0 = 9.9534e-04
Validation auc = 0.735607
Epoch 6780
Loss = 3.1449e-02, PNorm = 446.0328, GNorm = 0.0407, lr_0 = 9.9534e-04
Validation auc = 0.736650
Epoch 6781
Loss = 1.5600e-02, PNorm = 446.0511, GNorm = 2.5102, lr_0 = 9.9534e-04
Validation auc = 0.738339
Epoch 6782
Loss = 2.2977e-02, PNorm = 446.0752, GNorm = 1.8951, lr_0 = 9.9533e-04
Validation auc = 0.737439
Epoch 6783
Loss = 1.0040e-02, PNorm = 446.0995, GNorm = 0.2775, lr_0 = 9.9533e-04
Validation auc = 0.733723
Epoch 6784
Loss = 4.6127e-02, PNorm = 446.1206, GNorm = 0.0716, lr_0 = 9.9533e-04
Validation auc = 0.717326
Epoch 6785
Loss = 2.6353e-02, PNorm = 446.1449, GNorm = 0.3263, lr_0 = 9.9533e-04
Validation auc = 0.711428
Epoch 6786
Loss = 6.0900e-03, PNorm = 446.1690, GNorm = 0.0678, lr_0 = 9.9533e-04
Validation auc = 0.721118
Epoch 6787
Loss = 3.9730e-02, PNorm = 446.1918, GNorm = 0.8416, lr_0 = 9.9533e-04
Validation auc = 0.723762
Epoch 6788
Loss = 4.8041e-02, PNorm = 446.2177, GNorm = 2.5752, lr_0 = 9.9533e-04
Validation auc = 0.720773
Epoch 6789
Loss = 1.4312e-02, PNorm = 446.2455, GNorm = 0.5582, lr_0 = 9.9533e-04
Loss = 1.5858e-02, PNorm = 446.2663, GNorm = 0.1538, lr_0 = 9.9533e-04
Validation auc = 0.725432
Epoch 6790
Loss = 1.4778e-02, PNorm = 446.2862, GNorm = 0.6317, lr_0 = 9.9533e-04
Validation auc = 0.724185
Epoch 6791
Loss = 1.1680e-02, PNorm = 446.3030, GNorm = 0.2839, lr_0 = 9.9533e-04
Validation auc = 0.727039
Epoch 6792
Loss = 2.0917e-02, PNorm = 446.3275, GNorm = 0.1692, lr_0 = 9.9533e-04
Validation auc = 0.727715
Epoch 6793
Loss = 4.6145e-02, PNorm = 446.3576, GNorm = 1.7563, lr_0 = 9.9533e-04
Validation auc = 0.730451
Epoch 6794
Loss = 1.8211e-02, PNorm = 446.3874, GNorm = 0.9221, lr_0 = 9.9533e-04
Validation auc = 0.735040
Epoch 6795
Loss = 4.9248e-03, PNorm = 446.4155, GNorm = 0.0760, lr_0 = 9.9532e-04
Validation auc = 0.737501
Epoch 6796
Loss = 6.7459e-04, PNorm = 446.4352, GNorm = 0.0265, lr_0 = 9.9532e-04
Validation auc = 0.739281
Epoch 6797
Loss = 8.2957e-03, PNorm = 446.4477, GNorm = 0.6638, lr_0 = 9.9532e-04
Validation auc = 0.739888
Epoch 6798
Loss = 7.5486e-02, PNorm = 446.4612, GNorm = 2.8498, lr_0 = 9.9532e-04
Validation auc = 0.736432
Epoch 6799
Loss = 7.6884e-03, PNorm = 446.4821, GNorm = 0.3151, lr_0 = 9.9532e-04
Loss = 1.4992e-02, PNorm = 446.4966, GNorm = 0.0053, lr_0 = 9.9532e-04
Validation auc = 0.733457
Epoch 6800
Loss = 9.3221e-02, PNorm = 446.5190, GNorm = 5.8595, lr_0 = 9.9532e-04
Validation auc = 0.723791
Epoch 6801
Loss = 3.2191e-02, PNorm = 446.5697, GNorm = 1.4830, lr_0 = 9.9532e-04
Validation auc = 0.735970
Epoch 6802
Loss = 1.2016e-02, PNorm = 446.6091, GNorm = 2.0679, lr_0 = 9.9532e-04
Validation auc = 0.737898
Epoch 6803
Loss = 4.2756e-02, PNorm = 446.6346, GNorm = 2.1052, lr_0 = 9.9532e-04
Validation auc = 0.733773
Epoch 6804
Loss = 2.8018e-02, PNorm = 446.6568, GNorm = 1.2793, lr_0 = 9.9532e-04
Validation auc = 0.732280
Epoch 6805
Loss = 1.2467e-02, PNorm = 446.6781, GNorm = 1.5810, lr_0 = 9.9532e-04
Validation auc = 0.733493
Epoch 6806
Loss = 3.9316e-03, PNorm = 446.6961, GNorm = 0.0489, lr_0 = 9.9532e-04
Validation auc = 0.735363
Epoch 6807
Loss = 3.1533e-03, PNorm = 446.7099, GNorm = 0.1795, lr_0 = 9.9532e-04
Validation auc = 0.735745
Epoch 6808
Loss = 1.5623e-02, PNorm = 446.7201, GNorm = 1.9320, lr_0 = 9.9532e-04
Validation auc = 0.736605
Epoch 6809
Loss = 6.8047e-04, PNorm = 446.7342, GNorm = 0.0861, lr_0 = 9.9531e-04
Loss = 2.2303e-02, PNorm = 446.7502, GNorm = 1.1678, lr_0 = 9.9531e-04
Validation auc = 0.733268
Epoch 6810
Loss = 2.0020e-02, PNorm = 446.7677, GNorm = 1.2167, lr_0 = 9.9531e-04
Validation auc = 0.733275
Epoch 6811
Loss = 3.0325e-02, PNorm = 446.7910, GNorm = 2.1813, lr_0 = 9.9531e-04
Validation auc = 0.735010
Epoch 6812
Loss = 5.7813e-02, PNorm = 446.8214, GNorm = 2.0942, lr_0 = 9.9531e-04
Validation auc = 0.738204
Epoch 6813
Loss = 4.2231e-02, PNorm = 446.8539, GNorm = 0.0369, lr_0 = 9.9531e-04
Validation auc = 0.739876
Epoch 6814
Loss = 2.3748e-02, PNorm = 446.8873, GNorm = 1.3450, lr_0 = 9.9531e-04
Validation auc = 0.738163
Epoch 6815
Loss = 7.2432e-02, PNorm = 446.9156, GNorm = 0.8961, lr_0 = 9.9531e-04
Validation auc = 0.726048
Epoch 6816
Loss = 1.9692e-02, PNorm = 446.9454, GNorm = 0.1279, lr_0 = 9.9531e-04
Validation auc = 0.717290
Epoch 6817
Loss = 4.0735e-03, PNorm = 446.9740, GNorm = 0.1702, lr_0 = 9.9531e-04
Validation auc = 0.716092
Epoch 6818
Loss = 3.8360e-03, PNorm = 447.0007, GNorm = 0.0590, lr_0 = 9.9531e-04
Validation auc = 0.723434
Epoch 6819
Loss = 3.3328e-02, PNorm = 447.0267, GNorm = 0.9756, lr_0 = 9.9531e-04
Loss = 1.1896e-02, PNorm = 447.0478, GNorm = 1.0308, lr_0 = 9.9531e-04
Validation auc = 0.722509
Epoch 6820
Loss = 2.6102e-02, PNorm = 447.0703, GNorm = 0.8437, lr_0 = 9.9531e-04
Validation auc = 0.716713
Epoch 6821
Loss = 2.2445e-02, PNorm = 447.0961, GNorm = 0.5744, lr_0 = 9.9531e-04
Validation auc = 0.721380
Epoch 6822
Loss = 2.3998e-02, PNorm = 447.1186, GNorm = 2.0049, lr_0 = 9.9530e-04
Validation auc = 0.725456
Epoch 6823
Loss = 4.7277e-02, PNorm = 447.1405, GNorm = 0.6546, lr_0 = 9.9530e-04
Validation auc = 0.720949
Epoch 6824
Loss = 1.9219e-02, PNorm = 447.1739, GNorm = 0.0422, lr_0 = 9.9530e-04
Validation auc = 0.709865
Epoch 6825
Loss = 3.6854e-03, PNorm = 447.2128, GNorm = 0.0728, lr_0 = 9.9530e-04
Validation auc = 0.692575
Epoch 6826
Loss = 1.0009e-02, PNorm = 447.2512, GNorm = 0.5773, lr_0 = 9.9530e-04
Validation auc = 0.690626
Epoch 6827
Loss = 9.6273e-03, PNorm = 447.2800, GNorm = 0.1861, lr_0 = 9.9530e-04
Validation auc = 0.696440
Epoch 6828
Loss = 6.5311e-03, PNorm = 447.3064, GNorm = 0.7800, lr_0 = 9.9530e-04
Validation auc = 0.696957
Epoch 6829
Loss = 3.5909e-04, PNorm = 447.3307, GNorm = 0.0194, lr_0 = 9.9530e-04
Loss = 1.6963e-02, PNorm = 447.3505, GNorm = 0.0906, lr_0 = 9.9530e-04
Validation auc = 0.702208
Epoch 6830
Loss = 3.4787e-02, PNorm = 447.3760, GNorm = 1.5555, lr_0 = 9.9530e-04
Validation auc = 0.700093
Epoch 6831
Loss = 3.4597e-02, PNorm = 447.4254, GNorm = 0.6917, lr_0 = 9.9530e-04
Validation auc = 0.714831
Epoch 6832
Loss = 5.4193e-02, PNorm = 447.4732, GNorm = 0.0641, lr_0 = 9.9530e-04
Validation auc = 0.712881
Epoch 6833
Loss = 2.1396e-02, PNorm = 447.5199, GNorm = 0.1135, lr_0 = 9.9530e-04
Validation auc = 0.720423
Epoch 6834
Loss = 2.0974e-02, PNorm = 447.5591, GNorm = 0.0437, lr_0 = 9.9530e-04
Validation auc = 0.720571
Epoch 6835
Loss = 4.4683e-02, PNorm = 447.5933, GNorm = 0.5099, lr_0 = 9.9529e-04
Validation auc = 0.717619
Epoch 6836
Loss = 5.7912e-03, PNorm = 447.6166, GNorm = 0.1831, lr_0 = 9.9529e-04
Validation auc = 0.726670
Epoch 6837
Loss = 6.9255e-03, PNorm = 447.6333, GNorm = 0.1469, lr_0 = 9.9529e-04
Validation auc = 0.730706
Epoch 6838
Loss = 2.2150e-02, PNorm = 447.6505, GNorm = 0.2580, lr_0 = 9.9529e-04
Validation auc = 0.730770
Epoch 6839
Loss = 2.2628e-03, PNorm = 447.6704, GNorm = 0.0817, lr_0 = 9.9529e-04
Loss = 1.2331e-02, PNorm = 447.6976, GNorm = 0.2871, lr_0 = 9.9529e-04
Validation auc = 0.740123
Epoch 6840
Loss = 1.4120e-02, PNorm = 447.7201, GNorm = 0.4188, lr_0 = 9.9529e-04
Validation auc = 0.741140
Epoch 6841
Loss = 5.2925e-03, PNorm = 447.7394, GNorm = 0.0717, lr_0 = 9.9529e-04
Validation auc = 0.743375
Epoch 6842
Loss = 2.9127e-02, PNorm = 447.7607, GNorm = 0.5893, lr_0 = 9.9529e-04
Validation auc = 0.745685
Epoch 6843
Loss = 2.7574e-02, PNorm = 447.7920, GNorm = 0.8187, lr_0 = 9.9529e-04
Validation auc = 0.743363
Epoch 6844
Loss = 3.7791e-02, PNorm = 447.8259, GNorm = 1.3009, lr_0 = 9.9529e-04
Validation auc = 0.746738
Epoch 6845
Loss = 3.0301e-02, PNorm = 447.8529, GNorm = 0.5573, lr_0 = 9.9529e-04
Validation auc = 0.751714
Epoch 6846
Loss = 5.3533e-03, PNorm = 447.8805, GNorm = 0.1064, lr_0 = 9.9529e-04
Validation auc = 0.753237
Epoch 6847
Loss = 3.4142e-02, PNorm = 447.9035, GNorm = 1.0679, lr_0 = 9.9529e-04
Validation auc = 0.750843
Epoch 6848
Loss = 3.7152e-02, PNorm = 447.9361, GNorm = 1.1711, lr_0 = 9.9529e-04
Validation auc = 0.749453
Epoch 6849
Loss = 1.7036e-02, PNorm = 447.9653, GNorm = 0.9961, lr_0 = 9.9528e-04
Loss = 1.5370e-02, PNorm = 447.9850, GNorm = 0.5378, lr_0 = 9.9528e-04
Validation auc = 0.751995
Epoch 6850
Loss = 2.4001e-03, PNorm = 447.9991, GNorm = 0.3819, lr_0 = 9.9528e-04
Validation auc = 0.752591
Epoch 6851
Loss = 2.8139e-02, PNorm = 448.0100, GNorm = 1.6058, lr_0 = 9.9528e-04
Validation auc = 0.750700
Epoch 6852
Loss = 1.0588e-02, PNorm = 448.0325, GNorm = 1.8236, lr_0 = 9.9528e-04
Validation auc = 0.747745
Epoch 6853
Loss = 4.7720e-02, PNorm = 448.0565, GNorm = 0.2707, lr_0 = 9.9528e-04
Validation auc = 0.750641
Epoch 6854
Loss = 2.3722e-02, PNorm = 448.0886, GNorm = 1.1920, lr_0 = 9.9528e-04
Validation auc = 0.751124
Epoch 6855
Loss = 8.1489e-03, PNorm = 448.1133, GNorm = 0.0594, lr_0 = 9.9528e-04
Validation auc = 0.757604
Epoch 6856
Loss = 2.5096e-03, PNorm = 448.1318, GNorm = 0.1386, lr_0 = 9.9528e-04
Validation auc = 0.752850
Epoch 6857
Loss = 1.0225e-01, PNorm = 448.1506, GNorm = 0.7212, lr_0 = 9.9528e-04
Validation auc = 0.749615
Epoch 6858
Loss = 5.4688e-02, PNorm = 448.1813, GNorm = 1.2690, lr_0 = 9.9528e-04
Validation auc = 0.744088
Epoch 6859
Loss = 7.2101e-03, PNorm = 448.2180, GNorm = 0.2943, lr_0 = 9.9528e-04
Loss = 2.6552e-02, PNorm = 448.2565, GNorm = 0.8076, lr_0 = 9.9528e-04
Validation auc = 0.746381
Epoch 6860
Loss = 2.2066e-02, PNorm = 448.2919, GNorm = 0.0895, lr_0 = 9.9528e-04
Validation auc = 0.742932
Epoch 6861
Loss = 2.0936e-02, PNorm = 448.3289, GNorm = 0.1121, lr_0 = 9.9527e-04
Validation auc = 0.742590
Epoch 6862
Loss = 3.3658e-02, PNorm = 448.3648, GNorm = 2.2941, lr_0 = 9.9527e-04
Validation auc = 0.738607
Epoch 6863
Loss = 1.7835e-02, PNorm = 448.4009, GNorm = 0.2167, lr_0 = 9.9527e-04
Validation auc = 0.733768
Epoch 6864
Loss = 2.3083e-02, PNorm = 448.4339, GNorm = 1.8816, lr_0 = 9.9527e-04
Validation auc = 0.735847
Epoch 6865
Loss = 2.2532e-02, PNorm = 448.4726, GNorm = 0.0534, lr_0 = 9.9527e-04
Validation auc = 0.738769
Epoch 6866
Loss = 4.7341e-03, PNorm = 448.5017, GNorm = 0.1187, lr_0 = 9.9527e-04
Validation auc = 0.739581
Epoch 6867
Loss = 2.3904e-02, PNorm = 448.5219, GNorm = 1.0509, lr_0 = 9.9527e-04
Validation auc = 0.736653
Epoch 6868
Loss = 5.6711e-02, PNorm = 448.5474, GNorm = 1.6881, lr_0 = 9.9527e-04
Validation auc = 0.734053
Epoch 6869
Loss = 3.3632e-03, PNorm = 448.5958, GNorm = 0.1545, lr_0 = 9.9527e-04
Loss = 3.0855e-02, PNorm = 448.6407, GNorm = 1.1730, lr_0 = 9.9527e-04
Validation auc = 0.727437
Epoch 6870
Loss = 4.8944e-02, PNorm = 448.6879, GNorm = 0.3352, lr_0 = 9.9527e-04
Validation auc = 0.725031
Epoch 6871
Loss = 1.2229e-02, PNorm = 448.7392, GNorm = 1.1325, lr_0 = 9.9527e-04
Validation auc = 0.726090
Epoch 6872
Loss = 1.6379e-02, PNorm = 448.7775, GNorm = 0.3485, lr_0 = 9.9527e-04
Validation auc = 0.727904
Epoch 6873
Loss = 9.6667e-03, PNorm = 448.8139, GNorm = 0.0753, lr_0 = 9.9527e-04
Validation auc = 0.732750
Epoch 6874
Loss = 1.6680e-02, PNorm = 448.8434, GNorm = 0.7387, lr_0 = 9.9527e-04
Validation auc = 0.735739
Epoch 6875
Loss = 2.8534e-02, PNorm = 448.8706, GNorm = 0.0109, lr_0 = 9.9526e-04
Validation auc = 0.733912
Epoch 6876
Loss = 4.2181e-02, PNorm = 448.9062, GNorm = 1.9871, lr_0 = 9.9526e-04
Validation auc = 0.731912
Epoch 6877
Loss = 5.1161e-03, PNorm = 448.9471, GNorm = 0.2841, lr_0 = 9.9526e-04
Validation auc = 0.734252
Epoch 6878
Loss = 4.3202e-02, PNorm = 448.9879, GNorm = 2.2146, lr_0 = 9.9526e-04
Validation auc = 0.737853
Epoch 6879
Loss = 1.2786e-01, PNorm = 449.0429, GNorm = 1.9612, lr_0 = 9.9526e-04
Loss = 2.6571e-02, PNorm = 449.1055, GNorm = 0.1300, lr_0 = 9.9526e-04
Validation auc = 0.730630
Epoch 6880
Loss = 6.5505e-02, PNorm = 449.1508, GNorm = 4.5643, lr_0 = 9.9526e-04
Validation auc = 0.726846
Epoch 6881
Loss = 2.2161e-02, PNorm = 449.1953, GNorm = 0.6452, lr_0 = 9.9526e-04
Validation auc = 0.727086
Epoch 6882
Loss = 2.5877e-02, PNorm = 449.2293, GNorm = 0.0821, lr_0 = 9.9526e-04
Validation auc = 0.728126
Epoch 6883
Loss = 2.7689e-02, PNorm = 449.2591, GNorm = 0.8338, lr_0 = 9.9526e-04
Validation auc = 0.727922
Epoch 6884
Loss = 4.2515e-02, PNorm = 449.2822, GNorm = 1.5098, lr_0 = 9.9526e-04
Validation auc = 0.723683
Epoch 6885
Loss = 1.6366e-02, PNorm = 449.3103, GNorm = 0.7027, lr_0 = 9.9526e-04
Validation auc = 0.714908
Epoch 6886
Loss = 4.0468e-02, PNorm = 449.3481, GNorm = 1.6872, lr_0 = 9.9526e-04
Validation auc = 0.719949
Epoch 6887
Loss = 1.1732e-02, PNorm = 449.3968, GNorm = 0.6936, lr_0 = 9.9526e-04
Validation auc = 0.719126
Epoch 6888
Loss = 4.8833e-03, PNorm = 449.4381, GNorm = 0.3283, lr_0 = 9.9526e-04
Validation auc = 0.714493
Epoch 6889
Loss = 4.7597e-02, PNorm = 449.4696, GNorm = 1.0069, lr_0 = 9.9525e-04
Loss = 2.5567e-02, PNorm = 449.4986, GNorm = 0.0476, lr_0 = 9.9525e-04
Validation auc = 0.709036
Epoch 6890
Loss = 1.3851e-02, PNorm = 449.5230, GNorm = 0.4734, lr_0 = 9.9525e-04
Validation auc = 0.709875
Epoch 6891
Loss = 3.6255e-02, PNorm = 449.5431, GNorm = 0.2524, lr_0 = 9.9525e-04
Validation auc = 0.709435
Epoch 6892
Loss = 2.1776e-02, PNorm = 449.5660, GNorm = 0.5452, lr_0 = 9.9525e-04
Validation auc = 0.715648
Epoch 6893
Loss = 2.7220e-02, PNorm = 449.5934, GNorm = 1.3180, lr_0 = 9.9525e-04
Validation auc = 0.724383
Epoch 6894
Loss = 2.4163e-02, PNorm = 449.6241, GNorm = 0.8699, lr_0 = 9.9525e-04
Validation auc = 0.727331
Epoch 6895
Loss = 6.3173e-02, PNorm = 449.6467, GNorm = 1.0421, lr_0 = 9.9525e-04
Validation auc = 0.721187
Epoch 6896
Loss = 1.4509e-02, PNorm = 449.6739, GNorm = 0.3258, lr_0 = 9.9525e-04
Validation auc = 0.723762
Epoch 6897
Loss = 5.5406e-02, PNorm = 449.7043, GNorm = 1.4615, lr_0 = 9.9525e-04
Validation auc = 0.721095
Epoch 6898
Loss = 2.0829e-02, PNorm = 449.7388, GNorm = 1.8695, lr_0 = 9.9525e-04
Validation auc = 0.709860
Epoch 6899
Loss = 2.8619e-02, PNorm = 449.7766, GNorm = 1.1452, lr_0 = 9.9525e-04
Loss = 1.1288e-02, PNorm = 449.8092, GNorm = 2.3342, lr_0 = 9.9525e-04
Validation auc = 0.716922
Epoch 6900
Loss = 1.5380e-02, PNorm = 449.8359, GNorm = 0.0233, lr_0 = 9.9525e-04
Validation auc = 0.721512
Epoch 6901
Loss = 9.4688e-03, PNorm = 449.8619, GNorm = 0.4415, lr_0 = 9.9524e-04
Validation auc = 0.720752
Epoch 6902
Loss = 3.1845e-02, PNorm = 449.8891, GNorm = 0.1068, lr_0 = 9.9524e-04
Validation auc = 0.716539
Epoch 6903
Loss = 4.0084e-02, PNorm = 449.9240, GNorm = 0.3163, lr_0 = 9.9524e-04
Validation auc = 0.718066
Epoch 6904
Loss = 5.5716e-02, PNorm = 449.9600, GNorm = 1.0329, lr_0 = 9.9524e-04
Validation auc = 0.733489
Epoch 6905
Loss = 3.3043e-02, PNorm = 450.0015, GNorm = 1.0252, lr_0 = 9.9524e-04
Validation auc = 0.729668
Epoch 6906
Loss = 3.0611e-02, PNorm = 450.0381, GNorm = 1.3450, lr_0 = 9.9524e-04
Validation auc = 0.722905
Epoch 6907
Loss = 1.5359e-02, PNorm = 450.0722, GNorm = 0.9688, lr_0 = 9.9524e-04
Validation auc = 0.720626
Epoch 6908
Loss = 6.9295e-03, PNorm = 450.1022, GNorm = 0.2055, lr_0 = 9.9524e-04
Validation auc = 0.716758
Epoch 6909
Loss = 1.7407e-02, PNorm = 450.1345, GNorm = 0.5219, lr_0 = 9.9524e-04
Loss = 2.9652e-02, PNorm = 450.1680, GNorm = 5.3474, lr_0 = 9.9524e-04
Validation auc = 0.708702
Epoch 6910
Loss = 3.4037e-02, PNorm = 450.2061, GNorm = 0.8603, lr_0 = 9.9524e-04
Validation auc = 0.716266
Epoch 6911
Loss = 2.7218e-02, PNorm = 450.2465, GNorm = 1.0202, lr_0 = 9.9524e-04
Validation auc = 0.721423
Epoch 6912
Loss = 6.4811e-02, PNorm = 450.2885, GNorm = 3.5184, lr_0 = 9.9524e-04
Validation auc = 0.712666
Epoch 6913
Loss = 1.6462e-02, PNorm = 450.3216, GNorm = 0.2390, lr_0 = 9.9524e-04
Validation auc = 0.707629
Epoch 6914
Loss = 4.2527e-02, PNorm = 450.3525, GNorm = 0.1199, lr_0 = 9.9524e-04
Validation auc = 0.718740
Epoch 6915
Loss = 3.2027e-02, PNorm = 450.3863, GNorm = 2.5491, lr_0 = 9.9523e-04
Validation auc = 0.722250
Epoch 6916
Loss = 5.5398e-02, PNorm = 450.4127, GNorm = 1.6990, lr_0 = 9.9523e-04
Validation auc = 0.721948
Epoch 6917
Loss = 3.0152e-02, PNorm = 450.4351, GNorm = 0.7980, lr_0 = 9.9523e-04
Validation auc = 0.719200
Epoch 6918
Loss = 1.8214e-02, PNorm = 450.4548, GNorm = 1.1186, lr_0 = 9.9523e-04
Validation auc = 0.720909
Epoch 6919
Loss = 5.8165e-04, PNorm = 450.4720, GNorm = 0.0320, lr_0 = 9.9523e-04
Loss = 1.3003e-02, PNorm = 450.4871, GNorm = 0.0729, lr_0 = 9.9523e-04
Validation auc = 0.720620
Epoch 6920
Loss = 1.8137e-02, PNorm = 450.5148, GNorm = 0.5779, lr_0 = 9.9523e-04
Validation auc = 0.719516
Epoch 6921
Loss = 1.6860e-02, PNorm = 450.5407, GNorm = 0.0933, lr_0 = 9.9523e-04
Validation auc = 0.723407
Epoch 6922
Loss = 1.1182e-02, PNorm = 450.5659, GNorm = 0.3062, lr_0 = 9.9523e-04
Validation auc = 0.732350
Epoch 6923
Loss = 1.0873e-02, PNorm = 450.5875, GNorm = 0.1013, lr_0 = 9.9523e-04
Validation auc = 0.733704
Epoch 6924
Loss = 8.4214e-03, PNorm = 450.6120, GNorm = 1.0708, lr_0 = 9.9523e-04
Validation auc = 0.730737
Epoch 6925
Loss = 5.8965e-02, PNorm = 450.6426, GNorm = 1.1005, lr_0 = 9.9523e-04
Validation auc = 0.726754
Epoch 6926
Loss = 1.2936e-02, PNorm = 450.6902, GNorm = 0.6763, lr_0 = 9.9523e-04
Validation auc = 0.717397
Epoch 6927
Loss = 4.7502e-02, PNorm = 450.7365, GNorm = 0.0699, lr_0 = 9.9523e-04
Validation auc = 0.708358
Epoch 6928
Loss = 1.9263e-02, PNorm = 450.7724, GNorm = 1.3842, lr_0 = 9.9522e-04
Validation auc = 0.701972
Epoch 6929
Loss = 3.4244e-02, PNorm = 450.8114, GNorm = 1.7210, lr_0 = 9.9522e-04
Loss = 4.7297e-02, PNorm = 450.8498, GNorm = 0.1150, lr_0 = 9.9522e-04
Validation auc = 0.706638
Epoch 6930
Loss = 2.2992e-02, PNorm = 450.8874, GNorm = 0.0113, lr_0 = 9.9522e-04
Validation auc = 0.712151
Epoch 6931
Loss = 5.5130e-02, PNorm = 450.9229, GNorm = 0.0660, lr_0 = 9.9522e-04
Validation auc = 0.711925
Epoch 6932
Loss = 3.9260e-02, PNorm = 450.9573, GNorm = 2.0725, lr_0 = 9.9522e-04
Validation auc = 0.713321
Epoch 6933
Loss = 3.6859e-02, PNorm = 450.9935, GNorm = 0.8978, lr_0 = 9.9522e-04
Validation auc = 0.713805
Epoch 6934
Loss = 2.7752e-02, PNorm = 451.0320, GNorm = 0.1855, lr_0 = 9.9522e-04
Validation auc = 0.710862
Epoch 6935
Loss = 3.1711e-02, PNorm = 451.0840, GNorm = 3.9591, lr_0 = 9.9522e-04
Validation auc = 0.702635
Epoch 6936
Loss = 4.7356e-03, PNorm = 451.1385, GNorm = 0.5866, lr_0 = 9.9522e-04
Validation auc = 0.696425
Epoch 6937
Loss = 2.0926e-02, PNorm = 451.1867, GNorm = 0.0300, lr_0 = 9.9522e-04
Validation auc = 0.711557
Epoch 6938
Loss = 4.7984e-03, PNorm = 451.2386, GNorm = 0.2428, lr_0 = 9.9522e-04
Validation auc = 0.705268
Epoch 6939
Loss = 3.8282e-03, PNorm = 451.2807, GNorm = 0.1455, lr_0 = 9.9522e-04
Loss = 1.4271e-02, PNorm = 451.3156, GNorm = 0.9456, lr_0 = 9.9522e-04
Validation auc = 0.699025
Epoch 6940
Loss = 2.3338e-02, PNorm = 451.3486, GNorm = 0.2387, lr_0 = 9.9522e-04
Validation auc = 0.698705
Epoch 6941
Loss = 6.8203e-02, PNorm = 451.3740, GNorm = 0.4141, lr_0 = 9.9521e-04
Validation auc = 0.698607
Epoch 6942
Loss = 4.2121e-02, PNorm = 451.4037, GNorm = 0.6640, lr_0 = 9.9521e-04
Validation auc = 0.704402
Epoch 6943
Loss = 3.4661e-02, PNorm = 451.4330, GNorm = 0.2001, lr_0 = 9.9521e-04
Validation auc = 0.704985
Epoch 6944
Loss = 4.1197e-02, PNorm = 451.4683, GNorm = 1.2323, lr_0 = 9.9521e-04
Validation auc = 0.700646
Epoch 6945
Loss = 2.2267e-02, PNorm = 451.5025, GNorm = 0.1602, lr_0 = 9.9521e-04
Validation auc = 0.700684
Epoch 6946
Loss = 8.9152e-03, PNorm = 451.5364, GNorm = 0.3991, lr_0 = 9.9521e-04
Validation auc = 0.711130
Epoch 6947
Loss = 2.2649e-02, PNorm = 451.5687, GNorm = 0.9511, lr_0 = 9.9521e-04
Validation auc = 0.711490
Epoch 6948
Loss = 7.8415e-03, PNorm = 451.5937, GNorm = 1.0031, lr_0 = 9.9521e-04
Validation auc = 0.719169
Epoch 6949
Loss = 7.3671e-02, PNorm = 451.6249, GNorm = 1.7515, lr_0 = 9.9521e-04
Loss = 4.5528e-02, PNorm = 451.6609, GNorm = 0.2458, lr_0 = 9.9521e-04
Validation auc = 0.714589
Epoch 6950
Loss = 1.3291e-02, PNorm = 451.6944, GNorm = 3.4498, lr_0 = 9.9521e-04
Validation auc = 0.713009
Epoch 6951
Loss = 1.5753e-02, PNorm = 451.7239, GNorm = 1.4146, lr_0 = 9.9521e-04
Validation auc = 0.720095
Epoch 6952
Loss = 4.2756e-02, PNorm = 451.7607, GNorm = 0.8582, lr_0 = 9.9521e-04
Validation auc = 0.728170
Epoch 6953
Loss = 1.2807e-02, PNorm = 451.7960, GNorm = 0.1720, lr_0 = 9.9521e-04
Validation auc = 0.729463
Epoch 6954
Loss = 4.3988e-02, PNorm = 451.8258, GNorm = 1.1214, lr_0 = 9.9521e-04
Validation auc = 0.732018
Epoch 6955
Loss = 2.8255e-02, PNorm = 451.8537, GNorm = 1.9126, lr_0 = 9.9520e-04
Validation auc = 0.724902
Epoch 6956
Loss = 3.1713e-02, PNorm = 451.8821, GNorm = 1.5736, lr_0 = 9.9520e-04
Validation auc = 0.721740
Epoch 6957
Loss = 3.7409e-02, PNorm = 451.9067, GNorm = 0.9723, lr_0 = 9.9520e-04
Validation auc = 0.722272
Epoch 6958
Loss = 8.5011e-03, PNorm = 451.9291, GNorm = 0.4982, lr_0 = 9.9520e-04
Validation auc = 0.715459
Epoch 6959
Loss = 2.9846e-03, PNorm = 451.9539, GNorm = 0.2097, lr_0 = 9.9520e-04
Loss = 1.6861e-02, PNorm = 451.9829, GNorm = 0.2751, lr_0 = 9.9520e-04
Validation auc = 0.709352
Epoch 6960
Loss = 1.5556e-02, PNorm = 452.0080, GNorm = 0.0467, lr_0 = 9.9520e-04
Validation auc = 0.705569
Epoch 6961
Loss = 1.5558e-02, PNorm = 452.0341, GNorm = 0.1340, lr_0 = 9.9520e-04
Validation auc = 0.700817
Epoch 6962
Loss = 2.9472e-02, PNorm = 452.0599, GNorm = 0.3142, lr_0 = 9.9520e-04
Validation auc = 0.700385
Epoch 6963
Loss = 2.4857e-02, PNorm = 452.0876, GNorm = 1.6437, lr_0 = 9.9520e-04
Validation auc = 0.697929
Epoch 6964
Loss = 3.0960e-02, PNorm = 452.1177, GNorm = 0.0123, lr_0 = 9.9520e-04
Validation auc = 0.702815
Epoch 6965
Loss = 2.2879e-02, PNorm = 452.1589, GNorm = 2.4175, lr_0 = 9.9520e-04
Validation auc = 0.701693
Epoch 6966
Loss = 6.4658e-03, PNorm = 452.1954, GNorm = 0.1849, lr_0 = 9.9520e-04
Validation auc = 0.700120
Epoch 6967
Loss = 4.2133e-02, PNorm = 452.2253, GNorm = 2.6034, lr_0 = 9.9520e-04
Validation auc = 0.700486
Epoch 6968
Loss = 1.9346e-02, PNorm = 452.2770, GNorm = 0.1864, lr_0 = 9.9519e-04
Validation auc = 0.703826
Epoch 6969
Loss = 8.7212e-04, PNorm = 452.3155, GNorm = 0.0353, lr_0 = 9.9519e-04
Loss = 4.5970e-02, PNorm = 452.3426, GNorm = 2.1873, lr_0 = 9.9519e-04
Validation auc = 0.700412
Epoch 6970
Loss = 1.0151e-02, PNorm = 452.3684, GNorm = 0.6212, lr_0 = 9.9519e-04
Validation auc = 0.702450
Epoch 6971
Loss = 3.1090e-02, PNorm = 452.3992, GNorm = 2.4266, lr_0 = 9.9519e-04
Validation auc = 0.700594
Epoch 6972
Loss = 2.9408e-02, PNorm = 452.4335, GNorm = 1.1889, lr_0 = 9.9519e-04
Validation auc = 0.700399
Epoch 6973
Loss = 1.0084e-02, PNorm = 452.4656, GNorm = 0.2087, lr_0 = 9.9519e-04
Validation auc = 0.705872
Epoch 6974
Loss = 4.8534e-03, PNorm = 452.4920, GNorm = 0.7316, lr_0 = 9.9519e-04
Validation auc = 0.707354
Epoch 6975
Loss = 1.6575e-02, PNorm = 452.5154, GNorm = 1.6778, lr_0 = 9.9519e-04
Validation auc = 0.707905
Epoch 6976
Loss = 3.4471e-02, PNorm = 452.5405, GNorm = 1.7759, lr_0 = 9.9519e-04
Validation auc = 0.700026
Epoch 6977
Loss = 3.1274e-02, PNorm = 452.5754, GNorm = 1.1861, lr_0 = 9.9519e-04
Validation auc = 0.694741
Epoch 6978
Loss = 6.3060e-02, PNorm = 452.6192, GNorm = 1.2923, lr_0 = 9.9519e-04
Validation auc = 0.698440
Epoch 6979
Loss = 2.2852e-02, PNorm = 452.6541, GNorm = 0.6673, lr_0 = 9.9519e-04
Loss = 1.7937e-02, PNorm = 452.6904, GNorm = 0.0722, lr_0 = 9.9519e-04
Validation auc = 0.701217
Epoch 6980
Loss = 4.8632e-02, PNorm = 452.7172, GNorm = 3.6632, lr_0 = 9.9519e-04
Validation auc = 0.703664
Epoch 6981
Loss = 4.1632e-02, PNorm = 452.7449, GNorm = 0.6645, lr_0 = 9.9518e-04
Validation auc = 0.701594
Epoch 6982
Loss = 2.0640e-02, PNorm = 452.7771, GNorm = 0.3416, lr_0 = 9.9518e-04
Validation auc = 0.704035
Epoch 6983
Loss = 1.3551e-02, PNorm = 452.8062, GNorm = 2.3945, lr_0 = 9.9518e-04
Validation auc = 0.702562
Epoch 6984
Loss = 7.0308e-02, PNorm = 452.8373, GNorm = 0.5244, lr_0 = 9.9518e-04
Validation auc = 0.688719
Epoch 6985
Loss = 2.6253e-02, PNorm = 452.8721, GNorm = 2.0387, lr_0 = 9.9518e-04
Validation auc = 0.688522
Epoch 6986
Loss = 1.9258e-02, PNorm = 452.8986, GNorm = 0.9593, lr_0 = 9.9518e-04
Validation auc = 0.690565
Epoch 6987
Loss = 5.0721e-02, PNorm = 452.9266, GNorm = 0.0880, lr_0 = 9.9518e-04
Validation auc = 0.689676
Epoch 6988
Loss = 4.2620e-02, PNorm = 452.9582, GNorm = 1.0170, lr_0 = 9.9518e-04
Validation auc = 0.685474
Epoch 6989
Loss = 1.2770e-02, PNorm = 452.9926, GNorm = 0.4201, lr_0 = 9.9518e-04
Loss = 1.7394e-02, PNorm = 453.0243, GNorm = 1.5992, lr_0 = 9.9518e-04
Validation auc = 0.695634
Epoch 6990
Loss = 1.9330e-02, PNorm = 453.0484, GNorm = 0.7479, lr_0 = 9.9518e-04
Validation auc = 0.695150
Epoch 6991
Loss = 5.4532e-02, PNorm = 453.0724, GNorm = 0.0368, lr_0 = 9.9518e-04
Validation auc = 0.697722
Epoch 6992
Loss = 3.6444e-02, PNorm = 453.0982, GNorm = 0.4623, lr_0 = 9.9518e-04
Validation auc = 0.695550
Epoch 6993
Loss = 1.9953e-02, PNorm = 453.1220, GNorm = 0.7434, lr_0 = 9.9518e-04
Validation auc = 0.696823
Epoch 6994
Loss = 1.0349e-01, PNorm = 453.1466, GNorm = 0.3778, lr_0 = 9.9517e-04
Validation auc = 0.690138
Epoch 6995
Loss = 2.0081e-02, PNorm = 453.1752, GNorm = 0.9459, lr_0 = 9.9517e-04
Validation auc = 0.690646
Epoch 6996
Loss = 2.7283e-02, PNorm = 453.2014, GNorm = 0.3052, lr_0 = 9.9517e-04
Validation auc = 0.689886
Epoch 6997
Loss = 1.0103e-02, PNorm = 453.2228, GNorm = 1.0204, lr_0 = 9.9517e-04
Validation auc = 0.689947
Epoch 6998
Loss = 1.0623e-02, PNorm = 453.2454, GNorm = 0.0299, lr_0 = 9.9517e-04
Validation auc = 0.687911
Epoch 6999
Loss = 2.5356e-03, PNorm = 453.2661, GNorm = 0.1038, lr_0 = 9.9517e-04
Loss = 1.2023e-02, PNorm = 453.2866, GNorm = 0.1825, lr_0 = 9.9517e-04
Validation auc = 0.686603
Epoch 7000
Loss = 2.4405e-02, PNorm = 453.3059, GNorm = 0.1482, lr_0 = 9.9517e-04
Validation auc = 0.690426
Epoch 7001
Loss = 2.1946e-02, PNorm = 453.3288, GNorm = 0.0289, lr_0 = 9.9517e-04
Validation auc = 0.691511
Epoch 7002
Loss = 2.8916e-02, PNorm = 453.3532, GNorm = 0.8079, lr_0 = 9.9517e-04
Validation auc = 0.693456
Epoch 7003
Loss = 2.1095e-02, PNorm = 453.3839, GNorm = 2.1691, lr_0 = 9.9517e-04
Validation auc = 0.694505
Epoch 7004
Loss = 7.4340e-02, PNorm = 453.4130, GNorm = 5.0506, lr_0 = 9.9517e-04
Validation auc = 0.697587
Epoch 7005
Loss = 3.3043e-02, PNorm = 453.4444, GNorm = 1.6835, lr_0 = 9.9517e-04
Validation auc = 0.685859
Epoch 7006
Loss = 4.7354e-02, PNorm = 453.4799, GNorm = 0.1000, lr_0 = 9.9517e-04
Validation auc = 0.694154
Epoch 7007
Loss = 9.6946e-03, PNorm = 453.5217, GNorm = 0.4451, lr_0 = 9.9517e-04
Validation auc = 0.699436
Epoch 7008
Loss = 1.0519e-01, PNorm = 453.5572, GNorm = 2.1254, lr_0 = 9.9516e-04
Validation auc = 0.705958
Epoch 7009
Loss = 4.2290e-03, PNorm = 453.5902, GNorm = 0.1700, lr_0 = 9.9516e-04
Loss = 1.7910e-02, PNorm = 453.6196, GNorm = 1.3165, lr_0 = 9.9516e-04
Validation auc = 0.706863
Epoch 7010
Loss = 1.0078e-02, PNorm = 453.6422, GNorm = 0.2954, lr_0 = 9.9516e-04
Validation auc = 0.704543
Epoch 7011
Loss = 3.2921e-02, PNorm = 453.6699, GNorm = 1.7189, lr_0 = 9.9516e-04
Validation auc = 0.704580
Epoch 7012
Loss = 1.4958e-02, PNorm = 453.7034, GNorm = 1.6317, lr_0 = 9.9516e-04
Validation auc = 0.702092
Epoch 7013
Loss = 3.7545e-02, PNorm = 453.7430, GNorm = 2.0009, lr_0 = 9.9516e-04
Validation auc = 0.699384
Epoch 7014
Loss = 1.6629e-01, PNorm = 453.8018, GNorm = 3.9589, lr_0 = 9.9516e-04
Validation auc = 0.708485
Epoch 7015
Loss = 1.8854e-02, PNorm = 453.8774, GNorm = 0.3213, lr_0 = 9.9516e-04
Validation auc = 0.708363
Epoch 7016
Loss = 1.0340e-02, PNorm = 453.9343, GNorm = 1.3749, lr_0 = 9.9516e-04
Validation auc = 0.708627
Epoch 7017
Loss = 2.4892e-02, PNorm = 453.9759, GNorm = 0.4852, lr_0 = 9.9516e-04
Validation auc = 0.705138
Epoch 7018
Loss = 4.3286e-02, PNorm = 454.0158, GNorm = 0.2449, lr_0 = 9.9516e-04
Validation auc = 0.702367
Epoch 7019
Loss = 8.3620e-02, PNorm = 454.0688, GNorm = 1.5414, lr_0 = 9.9516e-04
Loss = 1.4275e-02, PNorm = 454.1234, GNorm = 0.6924, lr_0 = 9.9516e-04
Validation auc = 0.706836
Epoch 7020
Loss = 3.4045e-02, PNorm = 454.1626, GNorm = 0.8266, lr_0 = 9.9515e-04
Validation auc = 0.711422
Epoch 7021
Loss = 3.2280e-02, PNorm = 454.1965, GNorm = 0.7361, lr_0 = 9.9515e-04
Validation auc = 0.711125
Epoch 7022
Loss = 6.6890e-03, PNorm = 454.2312, GNorm = 0.1148, lr_0 = 9.9515e-04
Validation auc = 0.716966
Epoch 7023
Loss = 2.1440e-02, PNorm = 454.2611, GNorm = 0.3346, lr_0 = 9.9515e-04
Validation auc = 0.717889
Epoch 7024
Loss = 2.7770e-02, PNorm = 454.2954, GNorm = 0.0336, lr_0 = 9.9515e-04
Validation auc = 0.722132
Epoch 7025
Loss = 1.0621e-02, PNorm = 454.3428, GNorm = 0.5395, lr_0 = 9.9515e-04
Validation auc = 0.718822
Epoch 7026
Loss = 2.3034e-02, PNorm = 454.3861, GNorm = 0.0676, lr_0 = 9.9515e-04
Validation auc = 0.720390
Epoch 7027
Loss = 7.0387e-03, PNorm = 454.4271, GNorm = 0.3643, lr_0 = 9.9515e-04
Validation auc = 0.722130
Epoch 7028
Loss = 8.7876e-03, PNorm = 454.4549, GNorm = 0.9013, lr_0 = 9.9515e-04
Validation auc = 0.723144
Epoch 7029
Loss = 6.5293e-02, PNorm = 454.4754, GNorm = 4.4869, lr_0 = 9.9515e-04
Loss = 8.4754e-03, PNorm = 454.4989, GNorm = 0.3827, lr_0 = 9.9515e-04
Validation auc = 0.724839
Epoch 7030
Loss = 5.5669e-02, PNorm = 454.5211, GNorm = 2.4640, lr_0 = 9.9515e-04
Validation auc = 0.721879
Epoch 7031
Loss = 1.4988e-02, PNorm = 454.5467, GNorm = 1.0946, lr_0 = 9.9515e-04
Validation auc = 0.721852
Epoch 7032
Loss = 1.0453e-02, PNorm = 454.5734, GNorm = 0.2849, lr_0 = 9.9515e-04
Validation auc = 0.724340
Epoch 7033
Loss = 5.4159e-02, PNorm = 454.6000, GNorm = 0.2014, lr_0 = 9.9515e-04
Validation auc = 0.725225
Epoch 7034
Loss = 1.0802e-02, PNorm = 454.6426, GNorm = 0.8763, lr_0 = 9.9514e-04
Validation auc = 0.723372
Epoch 7035
Loss = 2.4244e-02, PNorm = 454.6821, GNorm = 0.1315, lr_0 = 9.9514e-04
Validation auc = 0.717144
Epoch 7036
Loss = 5.9042e-03, PNorm = 454.7205, GNorm = 0.0442, lr_0 = 9.9514e-04
Validation auc = 0.714891
Epoch 7037
Loss = 8.9171e-02, PNorm = 454.7480, GNorm = 2.0765, lr_0 = 9.9514e-04
Validation auc = 0.715304
Epoch 7038
Loss = 4.3790e-03, PNorm = 454.7745, GNorm = 0.0976, lr_0 = 9.9514e-04
Validation auc = 0.710639
Epoch 7039
Loss = 4.5496e-03, PNorm = 454.8100, GNorm = 0.1503, lr_0 = 9.9514e-04
Loss = 2.1372e-02, PNorm = 454.8547, GNorm = 0.5212, lr_0 = 9.9514e-04
Validation auc = 0.701955
Epoch 7040
Loss = 2.9373e-02, PNorm = 454.8870, GNorm = 0.1038, lr_0 = 9.9514e-04
Validation auc = 0.699459
Epoch 7041
Loss = 5.5169e-02, PNorm = 454.9198, GNorm = 3.0857, lr_0 = 9.9514e-04
Validation auc = 0.704605
Epoch 7042
Loss = 2.0609e-02, PNorm = 454.9602, GNorm = 0.4655, lr_0 = 9.9514e-04
Validation auc = 0.713001
Epoch 7043
Loss = 4.3876e-02, PNorm = 454.9974, GNorm = 0.2852, lr_0 = 9.9514e-04
Validation auc = 0.709759
Epoch 7044
Loss = 1.2230e-02, PNorm = 455.0279, GNorm = 0.1636, lr_0 = 9.9514e-04
Validation auc = 0.707531
Epoch 7045
Loss = 8.4485e-03, PNorm = 455.0502, GNorm = 0.5189, lr_0 = 9.9514e-04
Validation auc = 0.705471
Epoch 7046
Loss = 1.4478e-02, PNorm = 455.0692, GNorm = 0.0708, lr_0 = 9.9514e-04
Validation auc = 0.709518
Epoch 7047
Loss = 5.9170e-02, PNorm = 455.0947, GNorm = 0.0263, lr_0 = 9.9514e-04
Validation auc = 0.702133
Epoch 7048
Loss = 1.9212e-02, PNorm = 455.1268, GNorm = 0.7534, lr_0 = 9.9513e-04
Validation auc = 0.700286
Epoch 7049
Loss = 1.8963e-01, PNorm = 455.1627, GNorm = 5.9923, lr_0 = 9.9513e-04
Loss = 2.2183e-02, PNorm = 455.2169, GNorm = 0.1536, lr_0 = 9.9513e-04
Validation auc = 0.697969
Epoch 7050
Loss = 7.3367e-03, PNorm = 455.2600, GNorm = 0.2348, lr_0 = 9.9513e-04
Validation auc = 0.695565
Epoch 7051
Loss = 1.3140e-02, PNorm = 455.2921, GNorm = 1.7749, lr_0 = 9.9513e-04
Validation auc = 0.699525
Epoch 7052
Loss = 2.4204e-02, PNorm = 455.3173, GNorm = 0.0866, lr_0 = 9.9513e-04
Validation auc = 0.704165
Epoch 7053
Loss = 2.3470e-02, PNorm = 455.3441, GNorm = 0.2979, lr_0 = 9.9513e-04
Validation auc = 0.703368
Epoch 7054
Loss = 7.0311e-02, PNorm = 455.3758, GNorm = 1.8081, lr_0 = 9.9513e-04
Validation auc = 0.704396
Epoch 7055
Loss = 1.1320e-02, PNorm = 455.4162, GNorm = 1.4412, lr_0 = 9.9513e-04
Validation auc = 0.706087
Epoch 7056
Loss = 6.0280e-02, PNorm = 455.4515, GNorm = 1.0295, lr_0 = 9.9513e-04
Validation auc = 0.704654
Epoch 7057
Loss = 8.2624e-02, PNorm = 455.4913, GNorm = 0.7666, lr_0 = 9.9513e-04
Validation auc = 0.709969
Epoch 7058
Loss = 3.2477e-02, PNorm = 455.5294, GNorm = 1.1683, lr_0 = 9.9513e-04
Validation auc = 0.709192
Epoch 7059
Loss = 2.8903e-03, PNorm = 455.5682, GNorm = 0.1199, lr_0 = 9.9513e-04
Loss = 6.7078e-03, PNorm = 455.5948, GNorm = 0.0620, lr_0 = 9.9513e-04
Validation auc = 0.709349
Epoch 7060
Loss = 2.6758e-02, PNorm = 455.6197, GNorm = 0.6341, lr_0 = 9.9512e-04
Validation auc = 0.711041
Epoch 7061
Loss = 2.4155e-02, PNorm = 455.6481, GNorm = 0.3547, lr_0 = 9.9512e-04
Validation auc = 0.707202
Epoch 7062
Loss = 3.5037e-02, PNorm = 455.6808, GNorm = 0.1199, lr_0 = 9.9512e-04
Validation auc = 0.706002
Epoch 7063
Loss = 3.9093e-02, PNorm = 455.7167, GNorm = 1.3757, lr_0 = 9.9512e-04
Validation auc = 0.710368
Epoch 7064
Loss = 5.0651e-02, PNorm = 455.7486, GNorm = 3.8211, lr_0 = 9.9512e-04
Validation auc = 0.716668
Epoch 7065
Loss = 5.0262e-02, PNorm = 455.7831, GNorm = 0.5591, lr_0 = 9.9512e-04
Validation auc = 0.722136
Epoch 7066
Loss = 2.3534e-02, PNorm = 455.8237, GNorm = 0.2141, lr_0 = 9.9512e-04
Validation auc = 0.723553
Epoch 7067
Loss = 8.9842e-03, PNorm = 455.8577, GNorm = 0.1678, lr_0 = 9.9512e-04
Validation auc = 0.726914
Epoch 7068
Loss = 2.6960e-02, PNorm = 455.8894, GNorm = 1.0569, lr_0 = 9.9512e-04
Validation auc = 0.719723
Epoch 7069
Loss = 7.4416e-03, PNorm = 455.9208, GNorm = 0.4173, lr_0 = 9.9512e-04
Loss = 1.5485e-02, PNorm = 455.9445, GNorm = 0.2729, lr_0 = 9.9512e-04
Validation auc = 0.720729
Epoch 7070
Loss = 2.3824e-02, PNorm = 455.9644, GNorm = 1.6171, lr_0 = 9.9512e-04
Validation auc = 0.719608
Epoch 7071
Loss = 8.8662e-03, PNorm = 455.9852, GNorm = 0.1297, lr_0 = 9.9512e-04
Validation auc = 0.715452
Epoch 7072
Loss = 4.0688e-02, PNorm = 456.0071, GNorm = 0.2614, lr_0 = 9.9512e-04
Validation auc = 0.718219
Epoch 7073
Loss = 1.9874e-02, PNorm = 456.0415, GNorm = 0.7143, lr_0 = 9.9512e-04
Validation auc = 0.723600
Epoch 7074
Loss = 2.6049e-02, PNorm = 456.0753, GNorm = 0.3127, lr_0 = 9.9511e-04
Validation auc = 0.721170
Epoch 7075
Loss = 3.4411e-03, PNorm = 456.1054, GNorm = 0.2581, lr_0 = 9.9511e-04
Validation auc = 0.720543
Epoch 7076
Loss = 8.6474e-03, PNorm = 456.1246, GNorm = 0.8262, lr_0 = 9.9511e-04
Validation auc = 0.722373
Epoch 7077
Loss = 8.5582e-02, PNorm = 456.1455, GNorm = 0.0550, lr_0 = 9.9511e-04
Validation auc = 0.718539
Epoch 7078
Loss = 1.2511e-01, PNorm = 456.1765, GNorm = 6.3762, lr_0 = 9.9511e-04
Validation auc = 0.712852
Epoch 7079
Loss = 1.8664e-03, PNorm = 456.2077, GNorm = 0.1640, lr_0 = 9.9511e-04
Loss = 1.4911e-02, PNorm = 456.2380, GNorm = 0.2044, lr_0 = 9.9511e-04
Validation auc = 0.711763
Epoch 7080
Loss = 2.5738e-02, PNorm = 456.2632, GNorm = 0.3650, lr_0 = 9.9511e-04
Validation auc = 0.714629
Epoch 7081
Loss = 2.8724e-02, PNorm = 456.2909, GNorm = 2.3861, lr_0 = 9.9511e-04
Validation auc = 0.718943
Epoch 7082
Loss = 2.9026e-02, PNorm = 456.3270, GNorm = 0.6024, lr_0 = 9.9511e-04
Validation auc = 0.714653
Epoch 7083
Loss = 1.2148e-02, PNorm = 456.3589, GNorm = 0.3393, lr_0 = 9.9511e-04
Validation auc = 0.716232
Epoch 7084
Loss = 6.7150e-02, PNorm = 456.3850, GNorm = 0.1552, lr_0 = 9.9511e-04
Validation auc = 0.717368
Epoch 7085
Loss = 6.9829e-03, PNorm = 456.4133, GNorm = 0.5974, lr_0 = 9.9511e-04
Validation auc = 0.712392
Epoch 7086
Loss = 5.5590e-03, PNorm = 456.4455, GNorm = 0.1405, lr_0 = 9.9511e-04
Validation auc = 0.711295
Epoch 7087
Loss = 3.7764e-02, PNorm = 456.4884, GNorm = 0.3458, lr_0 = 9.9510e-04
Validation auc = 0.710014
Epoch 7088
Loss = 5.3439e-02, PNorm = 456.5342, GNorm = 0.1145, lr_0 = 9.9510e-04
Validation auc = 0.715170
Epoch 7089
Loss = 9.7950e-03, PNorm = 456.5760, GNorm = 0.4584, lr_0 = 9.9510e-04
Loss = 1.5840e-02, PNorm = 456.6132, GNorm = 0.0408, lr_0 = 9.9510e-04
Validation auc = 0.722143
Epoch 7090
Loss = 2.0500e-02, PNorm = 456.6492, GNorm = 0.6494, lr_0 = 9.9510e-04
Validation auc = 0.711232
Epoch 7091
Loss = 6.5632e-02, PNorm = 456.6735, GNorm = 2.2211, lr_0 = 9.9510e-04
Validation auc = 0.701749
Epoch 7092
Loss = 3.1017e-02, PNorm = 456.7011, GNorm = 1.1600, lr_0 = 9.9510e-04
Validation auc = 0.697062
Epoch 7093
Loss = 1.9727e-02, PNorm = 456.7287, GNorm = 1.7853, lr_0 = 9.9510e-04
Validation auc = 0.697197
Epoch 7094
Loss = 2.2800e-02, PNorm = 456.7580, GNorm = 0.2258, lr_0 = 9.9510e-04
Validation auc = 0.696674
Epoch 7095
Loss = 2.5770e-02, PNorm = 456.7850, GNorm = 0.0771, lr_0 = 9.9510e-04
Validation auc = 0.696514
Epoch 7096
Loss = 2.7034e-02, PNorm = 456.8136, GNorm = 1.1471, lr_0 = 9.9510e-04
Validation auc = 0.707653
Epoch 7097
Loss = 4.9149e-02, PNorm = 456.8554, GNorm = 1.4923, lr_0 = 9.9510e-04
Validation auc = 0.715925
Epoch 7098
Loss = 7.3294e-02, PNorm = 456.8952, GNorm = 1.5985, lr_0 = 9.9510e-04
Validation auc = 0.718139
Epoch 7099
Loss = 1.3855e-03, PNorm = 456.9333, GNorm = 0.0640, lr_0 = 9.9510e-04
Loss = 6.6823e-02, PNorm = 456.9748, GNorm = 0.7104, lr_0 = 9.9510e-04
Validation auc = 0.720574
Epoch 7100
Loss = 6.0072e-02, PNorm = 457.0325, GNorm = 0.1332, lr_0 = 9.9509e-04
Validation auc = 0.723788
Epoch 7101
Loss = 1.4709e-02, PNorm = 457.0817, GNorm = 1.1830, lr_0 = 9.9509e-04
Validation auc = 0.722557
Epoch 7102
Loss = 4.0787e-02, PNorm = 457.1202, GNorm = 0.0942, lr_0 = 9.9509e-04
Validation auc = 0.716435
Epoch 7103
Loss = 2.1103e-02, PNorm = 457.1485, GNorm = 0.9645, lr_0 = 9.9509e-04
Validation auc = 0.716348
Epoch 7104
Loss = 2.5000e-02, PNorm = 457.1724, GNorm = 0.6785, lr_0 = 9.9509e-04
Validation auc = 0.716241
Epoch 7105
Loss = 5.8736e-02, PNorm = 457.2082, GNorm = 2.1075, lr_0 = 9.9509e-04
Validation auc = 0.705472
Epoch 7106
Loss = 6.3527e-02, PNorm = 457.2511, GNorm = 0.3628, lr_0 = 9.9509e-04
Validation auc = 0.707523
Epoch 7107
Loss = 1.5925e-02, PNorm = 457.2903, GNorm = 0.8192, lr_0 = 9.9509e-04
Validation auc = 0.715176
Epoch 7108
Loss = 1.2619e-02, PNorm = 457.3288, GNorm = 0.2839, lr_0 = 9.9509e-04
Validation auc = 0.720297
Epoch 7109
Loss = 2.8098e-02, PNorm = 457.3639, GNorm = 0.7121, lr_0 = 9.9509e-04
Loss = 2.2327e-02, PNorm = 457.3941, GNorm = 1.2604, lr_0 = 9.9509e-04
Validation auc = 0.718878
Epoch 7110
Loss = 1.6246e-02, PNorm = 457.4222, GNorm = 0.3471, lr_0 = 9.9509e-04
Validation auc = 0.714207
Epoch 7111
Loss = 4.8251e-02, PNorm = 457.4597, GNorm = 2.7302, lr_0 = 9.9509e-04
Validation auc = 0.718644
Epoch 7112
Loss = 3.1200e-02, PNorm = 457.4980, GNorm = 2.2297, lr_0 = 9.9509e-04
Validation auc = 0.721672
Epoch 7113
Loss = 5.3255e-02, PNorm = 457.5318, GNorm = 1.1161, lr_0 = 9.9509e-04
Validation auc = 0.708144
Epoch 7114
Loss = 5.3425e-02, PNorm = 457.5692, GNorm = 1.0828, lr_0 = 9.9508e-04
Validation auc = 0.706266
Epoch 7115
Loss = 2.6201e-02, PNorm = 457.6086, GNorm = 0.2827, lr_0 = 9.9508e-04
Validation auc = 0.711366
Epoch 7116
Loss = 1.2623e-02, PNorm = 457.6478, GNorm = 1.4188, lr_0 = 9.9508e-04
Validation auc = 0.716916
Epoch 7117
Loss = 1.0879e-02, PNorm = 457.6849, GNorm = 0.1704, lr_0 = 9.9508e-04
Validation auc = 0.717789
Epoch 7118
Loss = 4.1147e-02, PNorm = 457.7214, GNorm = 1.2303, lr_0 = 9.9508e-04
Validation auc = 0.718897
Epoch 7119
Loss = 9.7099e-02, PNorm = 457.7478, GNorm = 1.6793, lr_0 = 9.9508e-04
Loss = 3.4536e-02, PNorm = 457.7704, GNorm = 1.6808, lr_0 = 9.9508e-04
Validation auc = 0.716475
Epoch 7120
Loss = 3.0897e-02, PNorm = 457.8018, GNorm = 1.4166, lr_0 = 9.9508e-04
Validation auc = 0.722299
Epoch 7121
Loss = 2.9461e-02, PNorm = 457.8350, GNorm = 0.5277, lr_0 = 9.9508e-04
Validation auc = 0.725351
Epoch 7122
Loss = 1.3857e-02, PNorm = 457.8623, GNorm = 1.9724, lr_0 = 9.9508e-04
Validation auc = 0.725187
Epoch 7123
Loss = 1.5761e-02, PNorm = 457.8840, GNorm = 0.0353, lr_0 = 9.9508e-04
Validation auc = 0.722929
Epoch 7124
Loss = 2.7329e-02, PNorm = 457.9075, GNorm = 0.7350, lr_0 = 9.9508e-04
Validation auc = 0.718013
Epoch 7125
Loss = 4.4605e-03, PNorm = 457.9401, GNorm = 0.0237, lr_0 = 9.9508e-04
Validation auc = 0.720347
Epoch 7126
Loss = 1.6859e-02, PNorm = 457.9742, GNorm = 1.8172, lr_0 = 9.9508e-04
Validation auc = 0.723121
Epoch 7127
Loss = 3.4899e-02, PNorm = 458.0196, GNorm = 0.6859, lr_0 = 9.9507e-04
Validation auc = 0.722358
Epoch 7128
Loss = 2.6789e-02, PNorm = 458.0612, GNorm = 0.3981, lr_0 = 9.9507e-04
Validation auc = 0.722405
Epoch 7129
Loss = 1.5682e-02, PNorm = 458.0927, GNorm = 0.8468, lr_0 = 9.9507e-04
Loss = 2.2138e-02, PNorm = 458.1191, GNorm = 2.4734, lr_0 = 9.9507e-04
Validation auc = 0.721699
Epoch 7130
Loss = 3.9767e-02, PNorm = 458.1512, GNorm = 0.5585, lr_0 = 9.9507e-04
Validation auc = 0.726313
Epoch 7131
Loss = 4.9868e-02, PNorm = 458.1871, GNorm = 0.2833, lr_0 = 9.9507e-04
Validation auc = 0.729084
Epoch 7132
Loss = 1.4274e-02, PNorm = 458.2215, GNorm = 0.9445, lr_0 = 9.9507e-04
Validation auc = 0.731339
Epoch 7133
Loss = 1.1856e-02, PNorm = 458.2520, GNorm = 0.0566, lr_0 = 9.9507e-04
Validation auc = 0.729699
Epoch 7134
Loss = 1.4495e-02, PNorm = 458.2741, GNorm = 0.0460, lr_0 = 9.9507e-04
Validation auc = 0.730772
Epoch 7135
Loss = 2.0438e-02, PNorm = 458.3063, GNorm = 3.6286, lr_0 = 9.9507e-04
Validation auc = 0.730405
Epoch 7136
Loss = 1.8771e-02, PNorm = 458.3467, GNorm = 0.8440, lr_0 = 9.9507e-04
Validation auc = 0.738240
Epoch 7137
Loss = 3.5121e-02, PNorm = 458.3830, GNorm = 0.4159, lr_0 = 9.9507e-04
Validation auc = 0.745666
Epoch 7138
Loss = 2.6714e-02, PNorm = 458.4194, GNorm = 1.9757, lr_0 = 9.9507e-04
Validation auc = 0.742054
Epoch 7139
Loss = 1.0378e-03, PNorm = 458.4533, GNorm = 0.0507, lr_0 = 9.9507e-04
Loss = 2.0930e-02, PNorm = 458.4821, GNorm = 0.5965, lr_0 = 9.9507e-04
Validation auc = 0.740926
Epoch 7140
Loss = 1.6756e-02, PNorm = 458.5096, GNorm = 0.2776, lr_0 = 9.9506e-04
Validation auc = 0.740878
Epoch 7141
Loss = 5.9727e-03, PNorm = 458.5377, GNorm = 0.5012, lr_0 = 9.9506e-04
Validation auc = 0.738248
Epoch 7142
Loss = 4.2018e-03, PNorm = 458.5577, GNorm = 0.0038, lr_0 = 9.9506e-04
Validation auc = 0.736902
Epoch 7143
Loss = 2.0655e-02, PNorm = 458.5689, GNorm = 0.0343, lr_0 = 9.9506e-04
Validation auc = 0.731454
Epoch 7144
Loss = 3.1627e-02, PNorm = 458.5816, GNorm = 0.1032, lr_0 = 9.9506e-04
Validation auc = 0.729682
Epoch 7145
Loss = 3.5112e-02, PNorm = 458.5974, GNorm = 0.4028, lr_0 = 9.9506e-04
Validation auc = 0.731168
Epoch 7146
Loss = 1.5748e-02, PNorm = 458.6175, GNorm = 0.0433, lr_0 = 9.9506e-04
Validation auc = 0.734440
Epoch 7147
Loss = 8.9535e-02, PNorm = 458.6405, GNorm = 1.5353, lr_0 = 9.9506e-04
Validation auc = 0.729451
Epoch 7148
Loss = 1.0011e-01, PNorm = 458.6714, GNorm = 3.1827, lr_0 = 9.9506e-04
Validation auc = 0.732951
Epoch 7149
Loss = 3.2329e-03, PNorm = 458.7130, GNorm = 0.3284, lr_0 = 9.9506e-04
Loss = 2.9894e-02, PNorm = 458.7429, GNorm = 1.0564, lr_0 = 9.9506e-04
Validation auc = 0.725777
Epoch 7150
Loss = 6.9286e-03, PNorm = 458.7642, GNorm = 0.0798, lr_0 = 9.9506e-04
Validation auc = 0.724670
Epoch 7151
Loss = 3.5742e-02, PNorm = 458.7782, GNorm = 0.8363, lr_0 = 9.9506e-04
Validation auc = 0.721702
Epoch 7152
Loss = 5.4826e-03, PNorm = 458.7927, GNorm = 0.2421, lr_0 = 9.9506e-04
Validation auc = 0.718990
Epoch 7153
Loss = 3.4674e-02, PNorm = 458.8102, GNorm = 0.1404, lr_0 = 9.9505e-04
Validation auc = 0.719769
Epoch 7154
Loss = 5.3586e-03, PNorm = 458.8410, GNorm = 1.0129, lr_0 = 9.9505e-04
Validation auc = 0.718218
Epoch 7155
Loss = 2.5572e-02, PNorm = 458.8741, GNorm = 1.1344, lr_0 = 9.9505e-04
Validation auc = 0.711298
Epoch 7156
Loss = 1.4740e-02, PNorm = 458.9082, GNorm = 1.2316, lr_0 = 9.9505e-04
Validation auc = 0.706902
Epoch 7157
Loss = 4.8736e-04, PNorm = 458.9358, GNorm = 0.0555, lr_0 = 9.9505e-04
Validation auc = 0.703018
Epoch 7158
Loss = 3.2095e-02, PNorm = 458.9570, GNorm = 2.5624, lr_0 = 9.9505e-04
Validation auc = 0.708603
Epoch 7159
Loss = 8.9973e-03, PNorm = 458.9817, GNorm = 0.5064, lr_0 = 9.9505e-04
Loss = 1.7934e-02, PNorm = 459.0084, GNorm = 0.1032, lr_0 = 9.9505e-04
Validation auc = 0.710687
Epoch 7160
Loss = 4.1231e-02, PNorm = 459.0313, GNorm = 1.0146, lr_0 = 9.9505e-04
Validation auc = 0.704903
Epoch 7161
Loss = 1.9405e-02, PNorm = 459.0545, GNorm = 0.4287, lr_0 = 9.9505e-04
Validation auc = 0.710899
Epoch 7162
Loss = 4.7733e-02, PNorm = 459.0739, GNorm = 0.4954, lr_0 = 9.9505e-04
Validation auc = 0.708637
Epoch 7163
Loss = 1.6411e-02, PNorm = 459.0953, GNorm = 2.4066, lr_0 = 9.9505e-04
Validation auc = 0.713210
Epoch 7164
Loss = 5.8214e-03, PNorm = 459.1249, GNorm = 0.5224, lr_0 = 9.9505e-04
Validation auc = 0.720893
Epoch 7165
Loss = 2.5465e-02, PNorm = 459.1524, GNorm = 2.4628, lr_0 = 9.9505e-04
Validation auc = 0.727008
Epoch 7166
Loss = 2.9477e-02, PNorm = 459.1793, GNorm = 0.4428, lr_0 = 9.9505e-04
Validation auc = 0.727187
Epoch 7167
Loss = 9.4387e-03, PNorm = 459.2001, GNorm = 0.5191, lr_0 = 9.9504e-04
Validation auc = 0.725425
Epoch 7168
Loss = 5.0641e-02, PNorm = 459.2214, GNorm = 0.0644, lr_0 = 9.9504e-04
Validation auc = 0.718302
Epoch 7169
Loss = 4.0739e-03, PNorm = 459.2524, GNorm = 0.2436, lr_0 = 9.9504e-04
Loss = 3.8384e-02, PNorm = 459.2764, GNorm = 1.4523, lr_0 = 9.9504e-04
Validation auc = 0.716553
Epoch 7170
Loss = 2.3546e-02, PNorm = 459.2993, GNorm = 0.5853, lr_0 = 9.9504e-04
Validation auc = 0.720562
Epoch 7171
Loss = 6.4193e-03, PNorm = 459.3200, GNorm = 0.1897, lr_0 = 9.9504e-04
Validation auc = 0.721454
Epoch 7172
Loss = 4.7255e-02, PNorm = 459.3357, GNorm = 0.8962, lr_0 = 9.9504e-04
Validation auc = 0.714896
Epoch 7173
Loss = 4.0558e-02, PNorm = 459.3611, GNorm = 0.1586, lr_0 = 9.9504e-04
Validation auc = 0.707975
Epoch 7174
Loss = 1.5763e-02, PNorm = 459.3930, GNorm = 1.1534, lr_0 = 9.9504e-04
Validation auc = 0.699635
Epoch 7175
Loss = 1.2708e-02, PNorm = 459.4254, GNorm = 1.1064, lr_0 = 9.9504e-04
Validation auc = 0.696557
Epoch 7176
Loss = 3.8580e-02, PNorm = 459.4570, GNorm = 1.9448, lr_0 = 9.9504e-04
Validation auc = 0.696224
Epoch 7177
Loss = 2.5074e-03, PNorm = 459.4855, GNorm = 0.1203, lr_0 = 9.9504e-04
Validation auc = 0.701006
Epoch 7178
Loss = 9.6569e-03, PNorm = 459.5078, GNorm = 0.7160, lr_0 = 9.9504e-04
Validation auc = 0.708256
Epoch 7179
Loss = 6.9998e-03, PNorm = 459.5300, GNorm = 0.2450, lr_0 = 9.9504e-04
Loss = 3.1588e-02, PNorm = 459.5506, GNorm = 2.6640, lr_0 = 9.9504e-04
Validation auc = 0.709661
Epoch 7180
Loss = 1.0750e-02, PNorm = 459.5710, GNorm = 1.7578, lr_0 = 9.9503e-04
Validation auc = 0.712843
Epoch 7181
Loss = 1.3634e-02, PNorm = 459.5900, GNorm = 0.0652, lr_0 = 9.9503e-04
Validation auc = 0.703900
Epoch 7182
Loss = 2.0908e-02, PNorm = 459.6075, GNorm = 0.4848, lr_0 = 9.9503e-04
Validation auc = 0.699459
Epoch 7183
Loss = 3.4334e-02, PNorm = 459.6275, GNorm = 1.2572, lr_0 = 9.9503e-04
Validation auc = 0.705088
Epoch 7184
Loss = 2.3143e-02, PNorm = 459.6506, GNorm = 0.0897, lr_0 = 9.9503e-04
Validation auc = 0.706007
Epoch 7185
Loss = 7.7860e-03, PNorm = 459.6714, GNorm = 0.2660, lr_0 = 9.9503e-04
Validation auc = 0.706713
Epoch 7186
Loss = 2.2370e-02, PNorm = 459.6916, GNorm = 0.2801, lr_0 = 9.9503e-04
Validation auc = 0.707033
Epoch 7187
Loss = 1.4460e-02, PNorm = 459.7160, GNorm = 0.6274, lr_0 = 9.9503e-04
Validation auc = 0.708138
Epoch 7188
Loss = 4.7028e-03, PNorm = 459.7377, GNorm = 0.1726, lr_0 = 9.9503e-04
Validation auc = 0.708757
Epoch 7189
Loss = 1.2703e-02, PNorm = 459.7585, GNorm = 0.6768, lr_0 = 9.9503e-04
Loss = 2.6996e-02, PNorm = 459.7811, GNorm = 1.0680, lr_0 = 9.9503e-04
Validation auc = 0.704476
Epoch 7190
Loss = 3.6955e-02, PNorm = 459.8050, GNorm = 0.0677, lr_0 = 9.9503e-04
Validation auc = 0.706306
Epoch 7191
Loss = 2.6512e-02, PNorm = 459.8316, GNorm = 0.4717, lr_0 = 9.9503e-04
Validation auc = 0.703264
Epoch 7192
Loss = 1.3393e-02, PNorm = 459.8588, GNorm = 1.3830, lr_0 = 9.9503e-04
Validation auc = 0.701010
Epoch 7193
Loss = 6.5518e-02, PNorm = 459.8872, GNorm = 3.9147, lr_0 = 9.9502e-04
Validation auc = 0.704951
Epoch 7194
Loss = 1.5056e-02, PNorm = 459.9181, GNorm = 0.1840, lr_0 = 9.9502e-04
Validation auc = 0.707875
Epoch 7195
Loss = 1.3261e-02, PNorm = 459.9402, GNorm = 0.5939, lr_0 = 9.9502e-04
Validation auc = 0.706767
Epoch 7196
Loss = 3.2122e-02, PNorm = 459.9638, GNorm = 0.5305, lr_0 = 9.9502e-04
Validation auc = 0.703839
Epoch 7197
Loss = 4.4703e-02, PNorm = 459.9907, GNorm = 0.2302, lr_0 = 9.9502e-04
Validation auc = 0.708777
Epoch 7198
Loss = 3.2150e-03, PNorm = 460.0125, GNorm = 0.1444, lr_0 = 9.9502e-04
Validation auc = 0.712155
Epoch 7199
Loss = 1.4613e-03, PNorm = 460.0357, GNorm = 0.0620, lr_0 = 9.9502e-04
Loss = 3.9142e-02, PNorm = 460.0568, GNorm = 0.5162, lr_0 = 9.9502e-04
Validation auc = 0.708613
Epoch 7200
Loss = 2.1250e-02, PNorm = 460.0873, GNorm = 1.8201, lr_0 = 9.9502e-04
Validation auc = 0.708035
Epoch 7201
Loss = 1.3928e-02, PNorm = 460.1188, GNorm = 0.9424, lr_0 = 9.9502e-04
Validation auc = 0.700055
Epoch 7202
Loss = 5.6289e-02, PNorm = 460.1444, GNorm = 2.2817, lr_0 = 9.9502e-04
Validation auc = 0.706206
Epoch 7203
Loss = 1.5909e-02, PNorm = 460.1742, GNorm = 0.0624, lr_0 = 9.9502e-04
Validation auc = 0.709272
Epoch 7204
Loss = 2.7509e-02, PNorm = 460.2028, GNorm = 0.3558, lr_0 = 9.9502e-04
Validation auc = 0.706261
Epoch 7205
Loss = 1.5229e-02, PNorm = 460.2420, GNorm = 0.0129, lr_0 = 9.9502e-04
Validation auc = 0.710816
Epoch 7206
Loss = 3.4436e-03, PNorm = 460.2817, GNorm = 0.0586, lr_0 = 9.9502e-04
Validation auc = 0.712018
Epoch 7207
Loss = 1.1569e-03, PNorm = 460.3103, GNorm = 0.1007, lr_0 = 9.9501e-04
Validation auc = 0.727300
Epoch 7208
Loss = 8.2146e-02, PNorm = 460.3458, GNorm = 0.0251, lr_0 = 9.9501e-04
Validation auc = 0.724164
Epoch 7209
Loss = 1.0827e-02, PNorm = 460.4014, GNorm = 0.6906, lr_0 = 9.9501e-04
Loss = 5.8488e-02, PNorm = 460.4543, GNorm = 1.1529, lr_0 = 9.9501e-04
Validation auc = 0.721317
Epoch 7210
Loss = 2.9849e-02, PNorm = 460.5034, GNorm = 1.1539, lr_0 = 9.9501e-04
Validation auc = 0.714664
Epoch 7211
Loss = 2.4095e-02, PNorm = 460.5385, GNorm = 1.1292, lr_0 = 9.9501e-04
Validation auc = 0.715083
Epoch 7212
Loss = 1.5123e-02, PNorm = 460.5709, GNorm = 0.4680, lr_0 = 9.9501e-04
Validation auc = 0.710256
Epoch 7213
Loss = 1.4210e-02, PNorm = 460.6018, GNorm = 0.8817, lr_0 = 9.9501e-04
Validation auc = 0.707581
Epoch 7214
Loss = 1.3943e-02, PNorm = 460.6269, GNorm = 0.5738, lr_0 = 9.9501e-04
Validation auc = 0.706598
Epoch 7215
Loss = 7.5224e-02, PNorm = 460.6631, GNorm = 3.6609, lr_0 = 9.9501e-04
Validation auc = 0.694008
Epoch 7216
Loss = 9.8965e-03, PNorm = 460.7021, GNorm = 0.4589, lr_0 = 9.9501e-04
Validation auc = 0.687690
Epoch 7217
Loss = 4.6332e-02, PNorm = 460.7333, GNorm = 1.1062, lr_0 = 9.9501e-04
Validation auc = 0.692421
Epoch 7218
Loss = 7.3192e-03, PNorm = 460.7626, GNorm = 0.1820, lr_0 = 9.9501e-04
Validation auc = 0.695087
Epoch 7219
Loss = 1.8155e-02, PNorm = 460.7904, GNorm = 0.4768, lr_0 = 9.9501e-04
Loss = 1.7915e-02, PNorm = 460.8127, GNorm = 0.1377, lr_0 = 9.9500e-04
Validation auc = 0.695765
Epoch 7220
Loss = 1.4121e-02, PNorm = 460.8336, GNorm = 0.2137, lr_0 = 9.9500e-04
Validation auc = 0.697929
Epoch 7221
Loss = 2.2580e-02, PNorm = 460.8494, GNorm = 2.8771, lr_0 = 9.9500e-04
Validation auc = 0.702339
Epoch 7222
Loss = 2.8348e-02, PNorm = 460.8682, GNorm = 2.5853, lr_0 = 9.9500e-04
Validation auc = 0.705752
Epoch 7223
Loss = 4.2831e-02, PNorm = 460.8874, GNorm = 3.7321, lr_0 = 9.9500e-04
Validation auc = 0.711239
Epoch 7224
Loss = 4.4835e-02, PNorm = 460.9172, GNorm = 0.0479, lr_0 = 9.9500e-04
Validation auc = 0.716229
Epoch 7225
Loss = 3.6552e-02, PNorm = 460.9447, GNorm = 0.2488, lr_0 = 9.9500e-04
Validation auc = 0.717093
Epoch 7226
Loss = 1.3155e-02, PNorm = 460.9709, GNorm = 1.5028, lr_0 = 9.9500e-04
Validation auc = 0.724543
Epoch 7227
Loss = 6.9370e-03, PNorm = 460.9992, GNorm = 0.6397, lr_0 = 9.9500e-04
Validation auc = 0.722518
Epoch 7228
Loss = 6.7486e-02, PNorm = 461.0187, GNorm = 1.4489, lr_0 = 9.9500e-04
Validation auc = 0.717100
Epoch 7229
Loss = 1.3666e-01, PNorm = 461.0340, GNorm = 2.5913, lr_0 = 9.9500e-04
Loss = 2.5627e-02, PNorm = 461.0553, GNorm = 0.2324, lr_0 = 9.9500e-04
Validation auc = 0.714583
Epoch 7230
Loss = 1.3973e-02, PNorm = 461.0817, GNorm = 0.3573, lr_0 = 9.9500e-04
Validation auc = 0.711851
Epoch 7231
Loss = 1.5721e-02, PNorm = 461.1036, GNorm = 0.1777, lr_0 = 9.9500e-04
Validation auc = 0.709374
Epoch 7232
Loss = 1.5574e-02, PNorm = 461.1218, GNorm = 0.2090, lr_0 = 9.9500e-04
Validation auc = 0.706223
Epoch 7233
Loss = 2.3332e-02, PNorm = 461.1435, GNorm = 0.4142, lr_0 = 9.9499e-04
Validation auc = 0.700611
Epoch 7234
Loss = 1.0704e-02, PNorm = 461.1665, GNorm = 2.4902, lr_0 = 9.9499e-04
Validation auc = 0.695343
Epoch 7235
Loss = 2.1007e-02, PNorm = 461.1958, GNorm = 0.0640, lr_0 = 9.9499e-04
Validation auc = 0.707997
Epoch 7236
Loss = 1.6661e-02, PNorm = 461.2257, GNorm = 1.4407, lr_0 = 9.9499e-04
Validation auc = 0.712508
Epoch 7237
Loss = 8.7421e-02, PNorm = 461.2513, GNorm = 1.3598, lr_0 = 9.9499e-04
Validation auc = 0.712798
Epoch 7238
Loss = 5.8377e-02, PNorm = 461.2738, GNorm = 5.8588, lr_0 = 9.9499e-04
Validation auc = 0.720716
Epoch 7239
Loss = 9.1007e-03, PNorm = 461.2948, GNorm = 0.4079, lr_0 = 9.9499e-04
Loss = 2.0467e-02, PNorm = 461.3153, GNorm = 0.2992, lr_0 = 9.9499e-04
Validation auc = 0.717756
Epoch 7240
Loss = 9.9853e-03, PNorm = 461.3315, GNorm = 1.3836, lr_0 = 9.9499e-04
Validation auc = 0.714284
Epoch 7241
Loss = 1.8056e-02, PNorm = 461.3481, GNorm = 0.1482, lr_0 = 9.9499e-04
Validation auc = 0.709830
Epoch 7242
Loss = 3.3418e-02, PNorm = 461.3685, GNorm = 0.2482, lr_0 = 9.9499e-04
Validation auc = 0.704945
Epoch 7243
Loss = 1.9842e-02, PNorm = 461.4011, GNorm = 0.0535, lr_0 = 9.9499e-04
Validation auc = 0.701682
Epoch 7244
Loss = 5.6327e-02, PNorm = 461.4274, GNorm = 1.8424, lr_0 = 9.9499e-04
Validation auc = 0.697370
Epoch 7245
Loss = 1.1529e-02, PNorm = 461.4536, GNorm = 0.3685, lr_0 = 9.9499e-04
Validation auc = 0.694916
Epoch 7246
Loss = 4.9844e-02, PNorm = 461.4766, GNorm = 2.1054, lr_0 = 9.9499e-04
Validation auc = 0.697067
Epoch 7247
Loss = 3.4197e-02, PNorm = 461.5094, GNorm = 0.6916, lr_0 = 9.9498e-04
Validation auc = 0.691889
Epoch 7248
Loss = 1.1282e-01, PNorm = 461.5404, GNorm = 0.0883, lr_0 = 9.9498e-04
Validation auc = 0.704103
Epoch 7249
Loss = 2.0057e-03, PNorm = 461.5743, GNorm = 0.1530, lr_0 = 9.9498e-04
Loss = 8.7125e-03, PNorm = 461.5978, GNorm = 0.3737, lr_0 = 9.9498e-04
Validation auc = 0.700786
Epoch 7250
Loss = 1.3314e-02, PNorm = 461.6188, GNorm = 0.1113, lr_0 = 9.9498e-04
Validation auc = 0.697977
Epoch 7251
Loss = 2.2515e-02, PNorm = 461.6473, GNorm = 0.8552, lr_0 = 9.9498e-04
Validation auc = 0.700935
Epoch 7252
Loss = 4.6128e-02, PNorm = 461.6767, GNorm = 0.1456, lr_0 = 9.9498e-04
Validation auc = 0.707266
Epoch 7253
Loss = 2.9078e-02, PNorm = 461.7050, GNorm = 0.0705, lr_0 = 9.9498e-04
Validation auc = 0.709457
Epoch 7254
Loss = 6.2089e-02, PNorm = 461.7356, GNorm = 2.8631, lr_0 = 9.9498e-04
Validation auc = 0.701549
Epoch 7255
Loss = 3.4316e-02, PNorm = 461.7838, GNorm = 0.3639, lr_0 = 9.9498e-04
Validation auc = 0.699965
Epoch 7256
Loss = 2.1171e-02, PNorm = 461.8322, GNorm = 0.9446, lr_0 = 9.9498e-04
Validation auc = 0.700984
Epoch 7257
Loss = 5.8313e-02, PNorm = 461.8804, GNorm = 0.1938, lr_0 = 9.9498e-04
Validation auc = 0.703467
Epoch 7258
Loss = 6.2832e-02, PNorm = 461.9222, GNorm = 1.6229, lr_0 = 9.9498e-04
Validation auc = 0.702242
Epoch 7259
Loss = 2.7556e-03, PNorm = 461.9481, GNorm = 0.4353, lr_0 = 9.9498e-04
Loss = 3.0039e-02, PNorm = 461.9640, GNorm = 0.2493, lr_0 = 9.9497e-04
Validation auc = 0.698004
Epoch 7260
Loss = 1.4895e-02, PNorm = 461.9832, GNorm = 0.2889, lr_0 = 9.9497e-04
Validation auc = 0.697952
Epoch 7261
Loss = 3.8766e-02, PNorm = 461.9987, GNorm = 1.2409, lr_0 = 9.9497e-04
Validation auc = 0.699439
Epoch 7262
Loss = 3.7261e-02, PNorm = 462.0242, GNorm = 1.1171, lr_0 = 9.9497e-04
Validation auc = 0.697000
Epoch 7263
Loss = 4.5549e-02, PNorm = 462.0594, GNorm = 1.1093, lr_0 = 9.9497e-04
Validation auc = 0.699097
Epoch 7264
Loss = 2.4259e-02, PNorm = 462.0927, GNorm = 0.4321, lr_0 = 9.9497e-04
Validation auc = 0.695836
Epoch 7265
Loss = 4.7905e-02, PNorm = 462.1230, GNorm = 0.6061, lr_0 = 9.9497e-04
Validation auc = 0.692589
Epoch 7266
Loss = 5.2638e-03, PNorm = 462.1609, GNorm = 0.4583, lr_0 = 9.9497e-04
Validation auc = 0.694662
Epoch 7267
Loss = 5.1975e-03, PNorm = 462.1931, GNorm = 0.1317, lr_0 = 9.9497e-04
Validation auc = 0.695200
Epoch 7268
Loss = 4.1246e-02, PNorm = 462.2160, GNorm = 2.0369, lr_0 = 9.9497e-04
Validation auc = 0.700689
Epoch 7269
Loss = 5.1557e-02, PNorm = 462.2452, GNorm = 0.9152, lr_0 = 9.9497e-04
Loss = 1.6601e-02, PNorm = 462.2753, GNorm = 0.0476, lr_0 = 9.9497e-04
Validation auc = 0.699152
Epoch 7270
Loss = 1.0957e-02, PNorm = 462.3038, GNorm = 0.0150, lr_0 = 9.9497e-04
Validation auc = 0.694475
Epoch 7271
Loss = 2.9517e-02, PNorm = 462.3355, GNorm = 1.1733, lr_0 = 9.9497e-04
Validation auc = 0.695467
Epoch 7272
Loss = 1.7281e-02, PNorm = 462.3680, GNorm = 1.6763, lr_0 = 9.9497e-04
Validation auc = 0.702697
Epoch 7273
Loss = 4.4098e-02, PNorm = 462.4016, GNorm = 0.5059, lr_0 = 9.9496e-04
Validation auc = 0.698698
Epoch 7274
Loss = 1.1763e-02, PNorm = 462.4355, GNorm = 0.5105, lr_0 = 9.9496e-04
Validation auc = 0.694164
Epoch 7275
Loss = 3.2266e-02, PNorm = 462.4576, GNorm = 0.0286, lr_0 = 9.9496e-04
Validation auc = 0.684095
Epoch 7276
Loss = 4.8301e-02, PNorm = 462.4806, GNorm = 4.1390, lr_0 = 9.9496e-04
Validation auc = 0.676275
Epoch 7277
Loss = 2.7005e-02, PNorm = 462.5135, GNorm = 0.0885, lr_0 = 9.9496e-04
Validation auc = 0.675927
Epoch 7278
Loss = 1.2204e-01, PNorm = 462.5440, GNorm = 2.7969, lr_0 = 9.9496e-04
Validation auc = 0.670097
Epoch 7279
Loss = 6.3158e-02, PNorm = 462.5880, GNorm = 2.0831, lr_0 = 9.9496e-04
Loss = 3.5332e-02, PNorm = 462.6251, GNorm = 6.9336, lr_0 = 9.9496e-04
Validation auc = 0.672229
Epoch 7280
Loss = 2.3459e-02, PNorm = 462.6679, GNorm = 2.3063, lr_0 = 9.9496e-04
Validation auc = 0.683673
Epoch 7281
Loss = 2.1994e-02, PNorm = 462.7053, GNorm = 0.2182, lr_0 = 9.9496e-04
Validation auc = 0.685505
Epoch 7282
Loss = 2.4089e-02, PNorm = 462.7442, GNorm = 0.8554, lr_0 = 9.9496e-04
Validation auc = 0.689406
Epoch 7283
Loss = 3.9380e-03, PNorm = 462.7757, GNorm = 0.0440, lr_0 = 9.9496e-04
Validation auc = 0.692008
Epoch 7284
Loss = 1.1775e-02, PNorm = 462.7927, GNorm = 1.0455, lr_0 = 9.9496e-04
Validation auc = 0.691279
Epoch 7285
Loss = 9.7422e-03, PNorm = 462.8092, GNorm = 0.1098, lr_0 = 9.9496e-04
Validation auc = 0.687200
Epoch 7286
Loss = 1.0293e-02, PNorm = 462.8296, GNorm = 0.5603, lr_0 = 9.9495e-04
Validation auc = 0.683904
Epoch 7287
Loss = 1.7423e-02, PNorm = 462.8527, GNorm = 1.5512, lr_0 = 9.9495e-04
Validation auc = 0.684894
Epoch 7288
Loss = 2.6144e-03, PNorm = 462.8807, GNorm = 0.0296, lr_0 = 9.9495e-04
Validation auc = 0.674698
Epoch 7289
Loss = 1.9218e-02, PNorm = 462.9054, GNorm = 1.2823, lr_0 = 9.9495e-04
Loss = 1.2909e-01, PNorm = 462.9697, GNorm = 0.7984, lr_0 = 9.9495e-04
Validation auc = 0.701970
Epoch 7290
Loss = 3.5111e-02, PNorm = 463.0457, GNorm = 0.4184, lr_0 = 9.9495e-04
Validation auc = 0.708641
Epoch 7291
Loss = 1.6530e-02, PNorm = 463.0896, GNorm = 0.2473, lr_0 = 9.9495e-04
Validation auc = 0.710897
Epoch 7292
Loss = 1.9164e-02, PNorm = 463.1174, GNorm = 0.1680, lr_0 = 9.9495e-04
Validation auc = 0.709897
Epoch 7293
Loss = 2.1331e-02, PNorm = 463.1424, GNorm = 2.4142, lr_0 = 9.9495e-04
Validation auc = 0.704864
Epoch 7294
Loss = 4.1664e-02, PNorm = 463.1689, GNorm = 0.2777, lr_0 = 9.9495e-04
Validation auc = 0.699177
Epoch 7295
Loss = 4.4520e-02, PNorm = 463.1965, GNorm = 2.0143, lr_0 = 9.9495e-04
Validation auc = 0.691934
Epoch 7296
Loss = 6.8707e-02, PNorm = 463.2208, GNorm = 1.6862, lr_0 = 9.9495e-04
Validation auc = 0.688019
Epoch 7297
Loss = 2.5061e-02, PNorm = 463.2452, GNorm = 0.6550, lr_0 = 9.9495e-04
Validation auc = 0.685760
Epoch 7298
Loss = 5.5723e-03, PNorm = 463.2660, GNorm = 0.2516, lr_0 = 9.9495e-04
Validation auc = 0.688417
Epoch 7299
Loss = 3.9398e-02, PNorm = 463.2829, GNorm = 2.0023, lr_0 = 9.9495e-04
Loss = 4.9498e-02, PNorm = 463.3080, GNorm = 1.1434, lr_0 = 9.9494e-04
Validation auc = 0.680916
Epoch 7300
Loss = 3.8252e-02, PNorm = 463.3462, GNorm = 0.9689, lr_0 = 9.9494e-04
Validation auc = 0.682362
Epoch 7301
Loss = 4.3197e-02, PNorm = 463.3907, GNorm = 2.9623, lr_0 = 9.9494e-04
Validation auc = 0.688940
Epoch 7302
Loss = 2.8307e-02, PNorm = 463.4288, GNorm = 1.1073, lr_0 = 9.9494e-04
Validation auc = 0.692772
Epoch 7303
Loss = 1.2658e-02, PNorm = 463.4567, GNorm = 1.0272, lr_0 = 9.9494e-04
Validation auc = 0.692194
Epoch 7304
Loss = 2.8667e-02, PNorm = 463.4798, GNorm = 0.0756, lr_0 = 9.9494e-04
Validation auc = 0.694615
Epoch 7305
Loss = 1.2448e-02, PNorm = 463.4970, GNorm = 1.3527, lr_0 = 9.9494e-04
Validation auc = 0.695948
Epoch 7306
Loss = 1.6921e-02, PNorm = 463.5179, GNorm = 1.2685, lr_0 = 9.9494e-04
Validation auc = 0.694542
Epoch 7307
Loss = 9.6480e-03, PNorm = 463.5501, GNorm = 0.0958, lr_0 = 9.9494e-04
Validation auc = 0.687972
Epoch 7308
Loss = 7.9179e-03, PNorm = 463.5780, GNorm = 0.2162, lr_0 = 9.9494e-04
Validation auc = 0.688015
Epoch 7309
Loss = 5.8176e-02, PNorm = 463.5991, GNorm = 1.5266, lr_0 = 9.9494e-04
Loss = 2.9416e-02, PNorm = 463.6223, GNorm = 0.2020, lr_0 = 9.9494e-04
Validation auc = 0.686271
Epoch 7310
Loss = 3.0227e-02, PNorm = 463.6446, GNorm = 1.0718, lr_0 = 9.9494e-04
Validation auc = 0.683835
Epoch 7311
Loss = 5.5972e-02, PNorm = 463.6691, GNorm = 0.0304, lr_0 = 9.9494e-04
Validation auc = 0.682193
Epoch 7312
Loss = 3.9154e-02, PNorm = 463.7070, GNorm = 1.1798, lr_0 = 9.9494e-04
Validation auc = 0.699666
Epoch 7313
Loss = 1.8865e-02, PNorm = 463.7487, GNorm = 0.9208, lr_0 = 9.9493e-04
Validation auc = 0.706132
Epoch 7314
Loss = 1.5199e-02, PNorm = 463.7804, GNorm = 0.2688, lr_0 = 9.9493e-04
Validation auc = 0.703409
Epoch 7315
Loss = 3.2362e-02, PNorm = 463.8076, GNorm = 0.1794, lr_0 = 9.9493e-04
Validation auc = 0.703796
Epoch 7316
Loss = 7.9791e-03, PNorm = 463.8330, GNorm = 0.1336, lr_0 = 9.9493e-04
Validation auc = 0.704744
Epoch 7317
Loss = 7.2870e-03, PNorm = 463.8544, GNorm = 0.5457, lr_0 = 9.9493e-04
Validation auc = 0.703435
Epoch 7318
Loss = 2.3807e-03, PNorm = 463.8754, GNorm = 0.0691, lr_0 = 9.9493e-04
Validation auc = 0.698611
Epoch 7319
Loss = 2.9927e-02, PNorm = 463.8976, GNorm = 2.4580, lr_0 = 9.9493e-04
Loss = 5.0526e-02, PNorm = 463.9274, GNorm = 0.2287, lr_0 = 9.9493e-04
Validation auc = 0.694464
Epoch 7320
Loss = 8.8220e-03, PNorm = 463.9568, GNorm = 1.4900, lr_0 = 9.9493e-04
Validation auc = 0.691815
Epoch 7321
Loss = 3.5033e-02, PNorm = 463.9850, GNorm = 2.7150, lr_0 = 9.9493e-04
Validation auc = 0.685333
Epoch 7322
Loss = 1.8654e-02, PNorm = 464.0175, GNorm = 0.0810, lr_0 = 9.9493e-04
Validation auc = 0.680367
Epoch 7323
Loss = 2.6477e-02, PNorm = 464.0457, GNorm = 2.4478, lr_0 = 9.9493e-04
Validation auc = 0.679269
Epoch 7324
Loss = 4.9008e-02, PNorm = 464.0757, GNorm = 0.1039, lr_0 = 9.9493e-04
Validation auc = 0.680258
Epoch 7325
Loss = 3.6221e-02, PNorm = 464.1164, GNorm = 0.2157, lr_0 = 9.9493e-04
Validation auc = 0.684526
Epoch 7326
Loss = 2.9957e-02, PNorm = 464.1607, GNorm = 1.4870, lr_0 = 9.9492e-04
Validation auc = 0.682475
Epoch 7327
Loss = 1.0011e-01, PNorm = 464.1964, GNorm = 0.1120, lr_0 = 9.9492e-04
Validation auc = 0.672488
Epoch 7328
Loss = 2.0592e-02, PNorm = 464.2311, GNorm = 0.1889, lr_0 = 9.9492e-04
Validation auc = 0.666102
Epoch 7329
Loss = 4.8267e-03, PNorm = 464.2559, GNorm = 0.1312, lr_0 = 9.9492e-04
Loss = 2.9496e-02, PNorm = 464.2824, GNorm = 1.4144, lr_0 = 9.9492e-04
Validation auc = 0.660941
Epoch 7330
Loss = 2.7673e-02, PNorm = 464.3075, GNorm = 0.5756, lr_0 = 9.9492e-04
Validation auc = 0.664733
Epoch 7331
Loss = 3.4827e-02, PNorm = 464.3274, GNorm = 0.0838, lr_0 = 9.9492e-04
Validation auc = 0.667321
Epoch 7332
Loss = 2.7475e-02, PNorm = 464.3615, GNorm = 2.3555, lr_0 = 9.9492e-04
Validation auc = 0.671478
Epoch 7333
Loss = 2.5691e-02, PNorm = 464.3983, GNorm = 0.1838, lr_0 = 9.9492e-04
Validation auc = 0.664063
Epoch 7334
Loss = 4.6108e-02, PNorm = 464.4288, GNorm = 0.1930, lr_0 = 9.9492e-04
Validation auc = 0.666985
Epoch 7335
Loss = 2.7920e-02, PNorm = 464.4570, GNorm = 2.1732, lr_0 = 9.9492e-04
Validation auc = 0.673029
Epoch 7336
Loss = 3.5540e-02, PNorm = 464.4780, GNorm = 1.0810, lr_0 = 9.9492e-04
Validation auc = 0.679692
Epoch 7337
Loss = 1.4537e-02, PNorm = 464.4956, GNorm = 0.1643, lr_0 = 9.9492e-04
Validation auc = 0.687081
Epoch 7338
Loss = 2.2162e-02, PNorm = 464.5211, GNorm = 0.1408, lr_0 = 9.9492e-04
Validation auc = 0.690945
Epoch 7339
Loss = 3.1950e-03, PNorm = 464.5470, GNorm = 0.1746, lr_0 = 9.9492e-04
Loss = 4.5942e-02, PNorm = 464.5751, GNorm = 1.2084, lr_0 = 9.9491e-04
Validation auc = 0.688614
Epoch 7340
Loss = 1.2114e-02, PNorm = 464.6072, GNorm = 1.1521, lr_0 = 9.9491e-04
Validation auc = 0.679760
Epoch 7341
Loss = 2.3798e-02, PNorm = 464.6329, GNorm = 1.4861, lr_0 = 9.9491e-04
Validation auc = 0.674634
Epoch 7342
Loss = 8.5433e-03, PNorm = 464.6567, GNorm = 1.3085, lr_0 = 9.9491e-04
Validation auc = 0.678485
Epoch 7343
Loss = 1.3413e-02, PNorm = 464.6883, GNorm = 0.4434, lr_0 = 9.9491e-04
Validation auc = 0.678600
Epoch 7344
Loss = 5.3585e-02, PNorm = 464.7236, GNorm = 2.4413, lr_0 = 9.9491e-04
Validation auc = 0.683978
Epoch 7345
Loss = 1.9382e-02, PNorm = 464.7585, GNorm = 2.0849, lr_0 = 9.9491e-04
Validation auc = 0.680506
Epoch 7346
Loss = 2.0034e-02, PNorm = 464.7955, GNorm = 0.1519, lr_0 = 9.9491e-04
Validation auc = 0.685695
Epoch 7347
Loss = 4.5639e-02, PNorm = 464.8297, GNorm = 0.0650, lr_0 = 9.9491e-04
Validation auc = 0.685012
Epoch 7348
Loss = 2.2702e-03, PNorm = 464.8597, GNorm = 0.1533, lr_0 = 9.9491e-04
Validation auc = 0.682583
Epoch 7349
Loss = 1.6481e-02, PNorm = 464.8839, GNorm = 1.2353, lr_0 = 9.9491e-04
Loss = 2.9961e-02, PNorm = 464.9072, GNorm = 0.0827, lr_0 = 9.9491e-04
Validation auc = 0.682163
Epoch 7350
Loss = 3.1586e-02, PNorm = 464.9304, GNorm = 0.8154, lr_0 = 9.9491e-04
Validation auc = 0.682806
Epoch 7351
Loss = 2.2905e-02, PNorm = 464.9550, GNorm = 0.2608, lr_0 = 9.9491e-04
Validation auc = 0.671179
Epoch 7352
Loss = 5.3250e-02, PNorm = 464.9820, GNorm = 0.2313, lr_0 = 9.9490e-04
Validation auc = 0.676749
Epoch 7353
Loss = 8.2625e-02, PNorm = 465.0197, GNorm = 0.8319, lr_0 = 9.9490e-04
Validation auc = 0.687086
Epoch 7354
Loss = 1.5585e-02, PNorm = 465.0612, GNorm = 0.4052, lr_0 = 9.9490e-04
Validation auc = 0.686571
Epoch 7355
Loss = 3.0662e-02, PNorm = 465.0945, GNorm = 0.0952, lr_0 = 9.9490e-04
Validation auc = 0.682430
Epoch 7356
Loss = 4.2651e-02, PNorm = 465.1238, GNorm = 0.8564, lr_0 = 9.9490e-04
Validation auc = 0.683216
Epoch 7357
Loss = 1.0075e-02, PNorm = 465.1496, GNorm = 0.6692, lr_0 = 9.9490e-04
Validation auc = 0.682496
Epoch 7358
Loss = 9.3093e-03, PNorm = 465.1755, GNorm = 0.1085, lr_0 = 9.9490e-04
Validation auc = 0.683387
Epoch 7359
Loss = 4.2542e-02, PNorm = 465.2118, GNorm = 1.4098, lr_0 = 9.9490e-04
Loss = 3.8796e-02, PNorm = 465.2741, GNorm = 0.6843, lr_0 = 9.9490e-04
Validation auc = 0.692230
Epoch 7360
Loss = 6.2781e-02, PNorm = 465.3192, GNorm = 0.5445, lr_0 = 9.9490e-04
Validation auc = 0.694521
Epoch 7361
Loss = 3.4813e-02, PNorm = 465.3522, GNorm = 1.2265, lr_0 = 9.9490e-04
Validation auc = 0.691655
Epoch 7362
Loss = 1.0596e-02, PNorm = 465.3767, GNorm = 0.1620, lr_0 = 9.9490e-04
Validation auc = 0.689277
Epoch 7363
Loss = 3.3770e-02, PNorm = 465.3947, GNorm = 0.2299, lr_0 = 9.9490e-04
Validation auc = 0.689811
Epoch 7364
Loss = 4.5242e-02, PNorm = 465.4220, GNorm = 0.2413, lr_0 = 9.9490e-04
Validation auc = 0.680169
Epoch 7365
Loss = 2.9165e-02, PNorm = 465.4608, GNorm = 1.1701, lr_0 = 9.9490e-04
Validation auc = 0.680562
Epoch 7366
Loss = 7.1987e-02, PNorm = 465.4962, GNorm = 2.1326, lr_0 = 9.9489e-04
Validation auc = 0.684731
Epoch 7367
Loss = 7.6191e-03, PNorm = 465.5365, GNorm = 0.1491, lr_0 = 9.9489e-04
Validation auc = 0.689821
Epoch 7368
Loss = 9.9854e-03, PNorm = 465.5761, GNorm = 0.1106, lr_0 = 9.9489e-04
Validation auc = 0.690944
Epoch 7369
Loss = 3.0551e-03, PNorm = 465.6110, GNorm = 0.0879, lr_0 = 9.9489e-04
Loss = 1.4626e-02, PNorm = 465.6403, GNorm = 1.3149, lr_0 = 9.9489e-04
Validation auc = 0.689967
Epoch 7370
Loss = 2.9761e-02, PNorm = 465.6695, GNorm = 0.1670, lr_0 = 9.9489e-04
Validation auc = 0.685461
Epoch 7371
Loss = 6.1890e-03, PNorm = 465.6899, GNorm = 0.7450, lr_0 = 9.9489e-04
Validation auc = 0.683510
Epoch 7372
Loss = 1.3652e-02, PNorm = 465.7031, GNorm = 0.0694, lr_0 = 9.9489e-04
Validation auc = 0.688194
Epoch 7373
Loss = 1.0455e-02, PNorm = 465.7172, GNorm = 0.4900, lr_0 = 9.9489e-04
Validation auc = 0.687527
Epoch 7374
Loss = 1.9796e-02, PNorm = 465.7354, GNorm = 1.2374, lr_0 = 9.9489e-04
Validation auc = 0.685385
Epoch 7375
Loss = 1.3160e-02, PNorm = 465.7630, GNorm = 0.1892, lr_0 = 9.9489e-04
Validation auc = 0.686771
Epoch 7376
Loss = 2.6914e-03, PNorm = 465.7909, GNorm = 0.0767, lr_0 = 9.9489e-04
Validation auc = 0.689071
Epoch 7377
Loss = 7.4249e-02, PNorm = 465.8237, GNorm = 1.4761, lr_0 = 9.9489e-04
Validation auc = 0.692366
Epoch 7378
Loss = 1.5236e-03, PNorm = 465.8729, GNorm = 0.0299, lr_0 = 9.9489e-04
Validation auc = 0.682677
Epoch 7379
Loss = 5.3593e-03, PNorm = 465.9071, GNorm = 0.3135, lr_0 = 9.9489e-04
Loss = 1.4842e-02, PNorm = 465.9349, GNorm = 0.4496, lr_0 = 9.9488e-04
Validation auc = 0.682093
Epoch 7380
Loss = 4.6423e-02, PNorm = 465.9657, GNorm = 0.5436, lr_0 = 9.9488e-04
Validation auc = 0.682967
Epoch 7381
Loss = 4.0977e-02, PNorm = 465.9893, GNorm = 0.1380, lr_0 = 9.9488e-04
Validation auc = 0.680767
Epoch 7382
Loss = 2.6260e-02, PNorm = 466.0086, GNorm = 0.9065, lr_0 = 9.9488e-04
Validation auc = 0.681313
Epoch 7383
Loss = 2.6838e-02, PNorm = 466.0312, GNorm = 0.1907, lr_0 = 9.9488e-04
Validation auc = 0.682651
Epoch 7384
Loss = 6.3489e-03, PNorm = 466.0605, GNorm = 0.1096, lr_0 = 9.9488e-04
Validation auc = 0.684098
Epoch 7385
Loss = 2.7114e-03, PNorm = 466.0927, GNorm = 0.0467, lr_0 = 9.9488e-04
Validation auc = 0.686474
Epoch 7386
Loss = 9.0492e-04, PNorm = 466.1288, GNorm = 0.0264, lr_0 = 9.9488e-04
Validation auc = 0.685365
Epoch 7387
Loss = 5.9671e-02, PNorm = 466.1602, GNorm = 0.0625, lr_0 = 9.9488e-04
Validation auc = 0.684126
Epoch 7388
Loss = 7.1039e-02, PNorm = 466.1953, GNorm = 3.3368, lr_0 = 9.9488e-04
Validation auc = 0.688124
Epoch 7389
Loss = 2.0231e-02, PNorm = 466.2304, GNorm = 1.2608, lr_0 = 9.9488e-04
Loss = 2.2711e-02, PNorm = 466.2566, GNorm = 1.8751, lr_0 = 9.9488e-04
Validation auc = 0.683322
Epoch 7390
Loss = 1.3927e-02, PNorm = 466.2847, GNorm = 1.5202, lr_0 = 9.9488e-04
Validation auc = 0.674496
Epoch 7391
Loss = 3.3867e-02, PNorm = 466.3128, GNorm = 2.5757, lr_0 = 9.9488e-04
Validation auc = 0.673448
Epoch 7392
Loss = 2.1608e-02, PNorm = 466.3490, GNorm = 1.7242, lr_0 = 9.9487e-04
Validation auc = 0.672294
Epoch 7393
Loss = 1.8099e-02, PNorm = 466.3751, GNorm = 0.8512, lr_0 = 9.9487e-04
Validation auc = 0.675723
Epoch 7394
Loss = 1.0985e-02, PNorm = 466.3956, GNorm = 1.1337, lr_0 = 9.9487e-04
Validation auc = 0.676186
Epoch 7395
Loss = 1.5952e-02, PNorm = 466.4246, GNorm = 1.5237, lr_0 = 9.9487e-04
Validation auc = 0.674162
Epoch 7396
Loss = 5.1705e-03, PNorm = 466.4596, GNorm = 0.0541, lr_0 = 9.9487e-04
Validation auc = 0.676508
Epoch 7397
Loss = 7.9316e-02, PNorm = 466.4825, GNorm = 4.9459, lr_0 = 9.9487e-04
Validation auc = 0.678132
Epoch 7398
Loss = 2.3152e-03, PNorm = 466.5098, GNorm = 0.0159, lr_0 = 9.9487e-04
Validation auc = 0.672403
Epoch 7399
Loss = 3.7456e-02, PNorm = 466.5443, GNorm = 2.7179, lr_0 = 9.9487e-04
Loss = 4.6969e-02, PNorm = 466.5897, GNorm = 0.4594, lr_0 = 9.9487e-04
Validation auc = 0.683523
Epoch 7400
Loss = 2.2412e-02, PNorm = 466.6250, GNorm = 0.0347, lr_0 = 9.9487e-04
Validation auc = 0.683849
Epoch 7401
Loss = 2.6880e-02, PNorm = 466.6549, GNorm = 0.0441, lr_0 = 9.9487e-04
Validation auc = 0.682423
Epoch 7402
Loss = 4.1325e-02, PNorm = 466.6874, GNorm = 0.4985, lr_0 = 9.9487e-04
Validation auc = 0.697196
Epoch 7403
Loss = 3.0113e-02, PNorm = 466.7293, GNorm = 1.1197, lr_0 = 9.9487e-04
Validation auc = 0.705876
Epoch 7404
Loss = 1.0005e-02, PNorm = 466.7614, GNorm = 0.2839, lr_0 = 9.9487e-04
Validation auc = 0.707497
Epoch 7405
Loss = 1.5349e-02, PNorm = 466.7869, GNorm = 1.1175, lr_0 = 9.9487e-04
Validation auc = 0.707021
Epoch 7406
Loss = 8.9929e-03, PNorm = 466.8166, GNorm = 2.0628, lr_0 = 9.9486e-04
Validation auc = 0.694174
Epoch 7407
Loss = 2.2558e-02, PNorm = 466.8485, GNorm = 1.8638, lr_0 = 9.9486e-04
Validation auc = 0.683418
Epoch 7408
Loss = 1.3928e-02, PNorm = 466.8794, GNorm = 1.7219, lr_0 = 9.9486e-04
Validation auc = 0.677895
Epoch 7409
Loss = 5.3724e-02, PNorm = 466.9053, GNorm = 1.3384, lr_0 = 9.9486e-04
Loss = 1.4624e-02, PNorm = 466.9250, GNorm = 0.1319, lr_0 = 9.9486e-04
Validation auc = 0.675317
Epoch 7410
Loss = 6.1482e-02, PNorm = 466.9549, GNorm = 1.8296, lr_0 = 9.9486e-04
Validation auc = 0.672061
Epoch 7411
Loss = 1.4178e-02, PNorm = 466.9834, GNorm = 0.0949, lr_0 = 9.9486e-04
Validation auc = 0.671702
Epoch 7412
Loss = 2.8611e-02, PNorm = 467.0046, GNorm = 0.1222, lr_0 = 9.9486e-04
Validation auc = 0.675702
Epoch 7413
Loss = 4.7247e-02, PNorm = 467.0299, GNorm = 0.0553, lr_0 = 9.9486e-04
Validation auc = 0.679619
Epoch 7414
Loss = 1.7778e-02, PNorm = 467.0563, GNorm = 0.5605, lr_0 = 9.9486e-04
Validation auc = 0.681615
Epoch 7415
Loss = 9.6583e-03, PNorm = 467.0848, GNorm = 0.3339, lr_0 = 9.9486e-04
Validation auc = 0.684929
Epoch 7416
Loss = 3.9277e-02, PNorm = 467.1148, GNorm = 0.3066, lr_0 = 9.9486e-04
Validation auc = 0.683676
Epoch 7417
Loss = 3.6245e-02, PNorm = 467.1435, GNorm = 0.9472, lr_0 = 9.9486e-04
Validation auc = 0.680301
Epoch 7418
Loss = 3.3580e-02, PNorm = 467.1668, GNorm = 2.2654, lr_0 = 9.9486e-04
Validation auc = 0.680891
Epoch 7419
Loss = 9.5205e-03, PNorm = 467.1894, GNorm = 0.3453, lr_0 = 9.9485e-04
Loss = 1.6205e-02, PNorm = 467.2130, GNorm = 1.8846, lr_0 = 9.9485e-04
Validation auc = 0.684213
Epoch 7420
Loss = 1.7298e-02, PNorm = 467.2373, GNorm = 0.1490, lr_0 = 9.9485e-04
Validation auc = 0.683930
Epoch 7421
Loss = 2.6910e-02, PNorm = 467.2607, GNorm = 0.8853, lr_0 = 9.9485e-04
Validation auc = 0.688713
Epoch 7422
Loss = 2.5993e-02, PNorm = 467.2904, GNorm = 0.3047, lr_0 = 9.9485e-04
Validation auc = 0.696325
Epoch 7423
Loss = 2.9941e-02, PNorm = 467.3319, GNorm = 0.4296, lr_0 = 9.9485e-04
Validation auc = 0.703243
Epoch 7424
Loss = 1.1967e-02, PNorm = 467.3745, GNorm = 2.9692, lr_0 = 9.9485e-04
Validation auc = 0.701220
Epoch 7425
Loss = 1.1184e-02, PNorm = 467.4059, GNorm = 0.3082, lr_0 = 9.9485e-04
Validation auc = 0.696055
Epoch 7426
Loss = 2.1689e-02, PNorm = 467.4348, GNorm = 0.0477, lr_0 = 9.9485e-04
Validation auc = 0.693168
Epoch 7427
Loss = 2.4850e-02, PNorm = 467.4608, GNorm = 1.8519, lr_0 = 9.9485e-04
Validation auc = 0.692552
Epoch 7428
Loss = 5.6039e-02, PNorm = 467.4931, GNorm = 5.9679, lr_0 = 9.9485e-04
Validation auc = 0.691544
Epoch 7429
Loss = 2.7174e-03, PNorm = 467.5378, GNorm = 0.1948, lr_0 = 9.9485e-04
Loss = 4.7532e-02, PNorm = 467.5829, GNorm = 2.6931, lr_0 = 9.9485e-04
Validation auc = 0.691358
Epoch 7430
Loss = 3.5095e-02, PNorm = 467.6307, GNorm = 2.5721, lr_0 = 9.9485e-04
Validation auc = 0.696390
Epoch 7431
Loss = 2.4313e-02, PNorm = 467.6810, GNorm = 0.3333, lr_0 = 9.9485e-04
Validation auc = 0.699924
Epoch 7432
Loss = 3.3306e-02, PNorm = 467.7153, GNorm = 0.0619, lr_0 = 9.9484e-04
Validation auc = 0.696081
Epoch 7433
Loss = 4.4795e-02, PNorm = 467.7491, GNorm = 0.2298, lr_0 = 9.9484e-04
Validation auc = 0.686215
Epoch 7434
Loss = 2.0796e-02, PNorm = 467.7862, GNorm = 0.1622, lr_0 = 9.9484e-04
Validation auc = 0.684583
Epoch 7435
Loss = 6.5698e-03, PNorm = 467.8189, GNorm = 0.2282, lr_0 = 9.9484e-04
Validation auc = 0.683324
Epoch 7436
Loss = 3.4388e-02, PNorm = 467.8464, GNorm = 0.0747, lr_0 = 9.9484e-04
Validation auc = 0.681949
Epoch 7437
Loss = 1.7400e-02, PNorm = 467.8792, GNorm = 0.0493, lr_0 = 9.9484e-04
Validation auc = 0.683294
Epoch 7438
Loss = 7.8816e-03, PNorm = 467.9102, GNorm = 0.3741, lr_0 = 9.9484e-04
Validation auc = 0.688316
Epoch 7439
Loss = 1.5881e-02, PNorm = 467.9319, GNorm = 0.7991, lr_0 = 9.9484e-04
Loss = 7.2719e-03, PNorm = 467.9499, GNorm = 0.1457, lr_0 = 9.9484e-04
Validation auc = 0.689333
Epoch 7440
Loss = 1.3317e-02, PNorm = 467.9624, GNorm = 0.6005, lr_0 = 9.9484e-04
Validation auc = 0.687840
Epoch 7441
Loss = 2.7869e-02, PNorm = 467.9777, GNorm = 1.6205, lr_0 = 9.9484e-04
Validation auc = 0.690303
Epoch 7442
Loss = 3.1613e-02, PNorm = 467.9936, GNorm = 2.2911, lr_0 = 9.9484e-04
Validation auc = 0.687757
Epoch 7443
Loss = 5.0100e-02, PNorm = 468.0161, GNorm = 0.9944, lr_0 = 9.9484e-04
Validation auc = 0.691351
Epoch 7444
Loss = 2.4296e-02, PNorm = 468.0458, GNorm = 0.6839, lr_0 = 9.9484e-04
Validation auc = 0.698198
Epoch 7445
Loss = 2.7965e-02, PNorm = 468.0734, GNorm = 0.2520, lr_0 = 9.9484e-04
Validation auc = 0.702791
Epoch 7446
Loss = 4.7443e-03, PNorm = 468.0917, GNorm = 0.4828, lr_0 = 9.9483e-04
Validation auc = 0.701798
Epoch 7447
Loss = 3.9346e-02, PNorm = 468.1038, GNorm = 0.0570, lr_0 = 9.9483e-04
Validation auc = 0.699171
Epoch 7448
Loss = 1.0289e-02, PNorm = 468.1186, GNorm = 0.9972, lr_0 = 9.9483e-04
Validation auc = 0.700003
Epoch 7449
Loss = 3.5622e-02, PNorm = 468.1331, GNorm = 1.4531, lr_0 = 9.9483e-04
Loss = 2.3161e-02, PNorm = 468.1500, GNorm = 0.1042, lr_0 = 9.9483e-04
Validation auc = 0.702891
Epoch 7450
Loss = 3.5819e-02, PNorm = 468.1733, GNorm = 0.1745, lr_0 = 9.9483e-04
Validation auc = 0.708536
Epoch 7451
Loss = 1.7756e-02, PNorm = 468.2029, GNorm = 0.1330, lr_0 = 9.9483e-04
Validation auc = 0.712389
Epoch 7452
Loss = 1.4633e-02, PNorm = 468.2300, GNorm = 0.1032, lr_0 = 9.9483e-04
Validation auc = 0.716806
Epoch 7453
Loss = 4.2181e-02, PNorm = 468.2497, GNorm = 0.0644, lr_0 = 9.9483e-04
Validation auc = 0.717794
Epoch 7454
Loss = 1.7111e-02, PNorm = 468.2760, GNorm = 0.3197, lr_0 = 9.9483e-04
Validation auc = 0.714740
Epoch 7455
Loss = 2.5438e-02, PNorm = 468.3079, GNorm = 1.2263, lr_0 = 9.9483e-04
Validation auc = 0.705842
Epoch 7456
Loss = 3.4821e-02, PNorm = 468.3316, GNorm = 1.1550, lr_0 = 9.9483e-04
Validation auc = 0.702591
Epoch 7457
Loss = 1.9516e-02, PNorm = 468.3534, GNorm = 0.2660, lr_0 = 9.9483e-04
Validation auc = 0.705009
Epoch 7458
Loss = 1.3760e-02, PNorm = 468.3753, GNorm = 0.3953, lr_0 = 9.9483e-04
Validation auc = 0.705535
Epoch 7459
Loss = 1.9095e-02, PNorm = 468.4055, GNorm = 0.8910, lr_0 = 9.9482e-04
Loss = 1.6398e-02, PNorm = 468.4273, GNorm = 2.2073, lr_0 = 9.9482e-04
Validation auc = 0.706100
Epoch 7460
Loss = 1.1697e-02, PNorm = 468.4480, GNorm = 0.7979, lr_0 = 9.9482e-04
Validation auc = 0.699594
Epoch 7461
Loss = 1.2760e-02, PNorm = 468.4695, GNorm = 0.4258, lr_0 = 9.9482e-04
Validation auc = 0.699031
Epoch 7462
Loss = 3.1160e-02, PNorm = 468.4917, GNorm = 1.8819, lr_0 = 9.9482e-04
Validation auc = 0.701234
Epoch 7463
Loss = 1.0347e-02, PNorm = 468.5119, GNorm = 1.7953, lr_0 = 9.9482e-04
Validation auc = 0.705501
Epoch 7464
Loss = 1.6661e-02, PNorm = 468.5390, GNorm = 0.0841, lr_0 = 9.9482e-04
Validation auc = 0.711864
Epoch 7465
Loss = 6.3382e-03, PNorm = 468.5609, GNorm = 0.4788, lr_0 = 9.9482e-04
Validation auc = 0.712522
Epoch 7466
Loss = 4.3027e-02, PNorm = 468.5760, GNorm = 3.0589, lr_0 = 9.9482e-04
Validation auc = 0.711943
Epoch 7467
Loss = 1.4415e-02, PNorm = 468.5998, GNorm = 0.0242, lr_0 = 9.9482e-04
Validation auc = 0.702601
Epoch 7468
Loss = 1.2456e-02, PNorm = 468.6372, GNorm = 0.3128, lr_0 = 9.9482e-04
Validation auc = 0.685682
Epoch 7469
Loss = 1.7372e-03, PNorm = 468.6797, GNorm = 0.1247, lr_0 = 9.9482e-04
Loss = 4.7183e-02, PNorm = 468.7244, GNorm = 3.4261, lr_0 = 9.9482e-04
Validation auc = 0.691623
Epoch 7470
Loss = 1.6504e-02, PNorm = 468.7722, GNorm = 0.6119, lr_0 = 9.9482e-04
Validation auc = 0.697919
Epoch 7471
Loss = 1.6286e-02, PNorm = 468.8134, GNorm = 0.0398, lr_0 = 9.9482e-04
Validation auc = 0.700872
Epoch 7472
Loss = 7.4574e-02, PNorm = 468.8462, GNorm = 4.7597, lr_0 = 9.9481e-04
Validation auc = 0.691671
Epoch 7473
Loss = 2.9691e-02, PNorm = 468.8837, GNorm = 1.3297, lr_0 = 9.9481e-04
Validation auc = 0.676881
Epoch 7474
Loss = 7.7265e-03, PNorm = 468.9215, GNorm = 0.5999, lr_0 = 9.9481e-04
Validation auc = 0.674754
Epoch 7475
Loss = 9.0370e-03, PNorm = 468.9460, GNorm = 0.9695, lr_0 = 9.9481e-04
Validation auc = 0.675738
Epoch 7476
Loss = 3.8325e-02, PNorm = 468.9655, GNorm = 0.6174, lr_0 = 9.9481e-04
Validation auc = 0.680868
Epoch 7477
Loss = 1.0824e-02, PNorm = 468.9917, GNorm = 0.3192, lr_0 = 9.9481e-04
Validation auc = 0.681242
Epoch 7478
Loss = 5.0990e-03, PNorm = 469.0234, GNorm = 0.2135, lr_0 = 9.9481e-04
Validation auc = 0.683229
Epoch 7479
Loss = 3.7939e-04, PNorm = 469.0434, GNorm = 0.0285, lr_0 = 9.9481e-04
Loss = 3.4339e-02, PNorm = 469.0703, GNorm = 1.5885, lr_0 = 9.9481e-04
Validation auc = 0.681656
Epoch 7480
Loss = 1.8390e-02, PNorm = 469.1024, GNorm = 1.2295, lr_0 = 9.9481e-04
Validation auc = 0.679870
Epoch 7481
Loss = 2.8465e-02, PNorm = 469.1474, GNorm = 0.0817, lr_0 = 9.9481e-04
Validation auc = 0.677882
Epoch 7482
Loss = 4.7835e-02, PNorm = 469.1984, GNorm = 0.9986, lr_0 = 9.9481e-04
Validation auc = 0.677771
Epoch 7483
Loss = 1.6511e-02, PNorm = 469.2398, GNorm = 2.2337, lr_0 = 9.9481e-04
Validation auc = 0.686676
Epoch 7484
Loss = 3.3505e-02, PNorm = 469.2908, GNorm = 0.4210, lr_0 = 9.9481e-04
Validation auc = 0.689278
Epoch 7485
Loss = 6.3503e-03, PNorm = 469.3330, GNorm = 0.6419, lr_0 = 9.9480e-04
Validation auc = 0.689559
Epoch 7486
Loss = 2.5975e-02, PNorm = 469.3674, GNorm = 0.1268, lr_0 = 9.9480e-04
Validation auc = 0.700555
Epoch 7487
Loss = 9.3199e-02, PNorm = 469.4037, GNorm = 7.7509, lr_0 = 9.9480e-04
Validation auc = 0.705941
Epoch 7488
Loss = 1.2375e-02, PNorm = 469.4457, GNorm = 1.6843, lr_0 = 9.9480e-04
Validation auc = 0.703498
Epoch 7489
Loss = 2.3219e-03, PNorm = 469.4814, GNorm = 0.2943, lr_0 = 9.9480e-04
Loss = 4.1046e-02, PNorm = 469.5215, GNorm = 0.8187, lr_0 = 9.9480e-04
Validation auc = 0.702967
Epoch 7490
Loss = 2.8800e-02, PNorm = 469.5628, GNorm = 0.1295, lr_0 = 9.9480e-04
Validation auc = 0.698834
Epoch 7491
Loss = 7.4633e-02, PNorm = 469.6073, GNorm = 0.2165, lr_0 = 9.9480e-04
Validation auc = 0.709134
Epoch 7492
Loss = 4.0924e-02, PNorm = 469.6600, GNorm = 0.5273, lr_0 = 9.9480e-04
Validation auc = 0.705528
Epoch 7493
Loss = 2.8182e-02, PNorm = 469.7013, GNorm = 1.5126, lr_0 = 9.9480e-04
Validation auc = 0.706293
Epoch 7494
Loss = 6.0020e-02, PNorm = 469.7408, GNorm = 0.3117, lr_0 = 9.9480e-04
Validation auc = 0.705905
Epoch 7495
Loss = 1.1362e-01, PNorm = 469.8037, GNorm = 0.4788, lr_0 = 9.9480e-04
Validation auc = 0.700160
Epoch 7496
Loss = 1.1872e-01, PNorm = 469.8743, GNorm = 7.0394, lr_0 = 9.9480e-04
Validation auc = 0.715864
Epoch 7497
Loss = 4.5986e-02, PNorm = 469.9465, GNorm = 2.3604, lr_0 = 9.9480e-04
Validation auc = 0.705661
Epoch 7498
Loss = 2.8273e-02, PNorm = 470.0043, GNorm = 0.5417, lr_0 = 9.9480e-04
Validation auc = 0.706003
Epoch 7499
Loss = 6.1867e-02, PNorm = 470.0542, GNorm = 1.5585, lr_0 = 9.9479e-04
Loss = 2.8618e-02, PNorm = 470.0886, GNorm = 2.0350, lr_0 = 9.9479e-04
Validation auc = 0.705313
Epoch 7500
Loss = 2.1547e-02, PNorm = 470.1185, GNorm = 0.6685, lr_0 = 9.9479e-04
Validation auc = 0.707991
Epoch 7501
Loss = 3.6418e-02, PNorm = 470.1445, GNorm = 3.0487, lr_0 = 9.9479e-04
Validation auc = 0.713689
Epoch 7502
Loss = 2.4635e-02, PNorm = 470.1714, GNorm = 0.5492, lr_0 = 9.9479e-04
Validation auc = 0.712641
Epoch 7503
Loss = 6.4930e-02, PNorm = 470.2005, GNorm = 0.9794, lr_0 = 9.9479e-04
Validation auc = 0.717944
Epoch 7504
Loss = 5.3949e-02, PNorm = 470.2370, GNorm = 2.3716, lr_0 = 9.9479e-04
Validation auc = 0.719166
Epoch 7505
Loss = 1.8076e-02, PNorm = 470.2746, GNorm = 0.1183, lr_0 = 9.9479e-04
Validation auc = 0.721303
Epoch 7506
Loss = 2.9181e-02, PNorm = 470.3091, GNorm = 0.2117, lr_0 = 9.9479e-04
Validation auc = 0.722284
Epoch 7507
Loss = 7.3142e-03, PNorm = 470.3411, GNorm = 0.1331, lr_0 = 9.9479e-04
Validation auc = 0.726715
Epoch 7508
Loss = 2.7415e-02, PNorm = 470.3711, GNorm = 0.1647, lr_0 = 9.9479e-04
Validation auc = 0.729941
Epoch 7509
Loss = 2.5727e-02, PNorm = 470.3965, GNorm = 1.4621, lr_0 = 9.9479e-04
Loss = 9.3651e-03, PNorm = 470.4179, GNorm = 0.0777, lr_0 = 9.9479e-04
Validation auc = 0.735216
Epoch 7510
Loss = 2.3115e-02, PNorm = 470.4395, GNorm = 0.0595, lr_0 = 9.9479e-04
Validation auc = 0.740301
Epoch 7511
Loss = 5.3108e-02, PNorm = 470.4733, GNorm = 0.1061, lr_0 = 9.9479e-04
Validation auc = 0.738024
Epoch 7512
Loss = 3.2499e-02, PNorm = 470.5109, GNorm = 1.3631, lr_0 = 9.9478e-04
Validation auc = 0.738762
Epoch 7513
Loss = 3.6482e-02, PNorm = 470.5566, GNorm = 0.0278, lr_0 = 9.9478e-04
Validation auc = 0.727423
Epoch 7514
Loss = 7.6117e-03, PNorm = 470.5918, GNorm = 0.0896, lr_0 = 9.9478e-04
Validation auc = 0.719668
Epoch 7515
Loss = 4.4212e-02, PNorm = 470.6166, GNorm = 0.0820, lr_0 = 9.9478e-04
Validation auc = 0.721136
Epoch 7516
Loss = 2.2848e-02, PNorm = 470.6400, GNorm = 0.1126, lr_0 = 9.9478e-04
Validation auc = 0.718714
Epoch 7517
Loss = 2.8602e-02, PNorm = 470.6703, GNorm = 0.2651, lr_0 = 9.9478e-04
Validation auc = 0.719882
Epoch 7518
Loss = 1.0771e-02, PNorm = 470.7081, GNorm = 0.0947, lr_0 = 9.9478e-04
Validation auc = 0.723783
Epoch 7519
Loss = 1.6179e-02, PNorm = 470.7372, GNorm = 0.6180, lr_0 = 9.9478e-04
Loss = 1.2548e-02, PNorm = 470.7636, GNorm = 0.2440, lr_0 = 9.9478e-04
Validation auc = 0.723711
Epoch 7520
Loss = 4.9863e-02, PNorm = 470.7969, GNorm = 1.7234, lr_0 = 9.9478e-04
Validation auc = 0.725942
Epoch 7521
Loss = 2.4888e-02, PNorm = 470.8355, GNorm = 0.2741, lr_0 = 9.9478e-04
Validation auc = 0.725953
Epoch 7522
Loss = 3.2501e-02, PNorm = 470.8647, GNorm = 1.4816, lr_0 = 9.9478e-04
Validation auc = 0.722995
Epoch 7523
Loss = 3.2679e-03, PNorm = 470.8877, GNorm = 0.0822, lr_0 = 9.9478e-04
Validation auc = 0.721965
Epoch 7524
Loss = 9.0055e-03, PNorm = 470.9066, GNorm = 1.2930, lr_0 = 9.9478e-04
Validation auc = 0.723698
Epoch 7525
Loss = 1.4046e-02, PNorm = 470.9189, GNorm = 0.4776, lr_0 = 9.9477e-04
Validation auc = 0.719464
Epoch 7526
Loss = 1.0118e-02, PNorm = 470.9340, GNorm = 0.5627, lr_0 = 9.9477e-04
Validation auc = 0.723897
Epoch 7527
Loss = 1.7165e-02, PNorm = 470.9551, GNorm = 0.0284, lr_0 = 9.9477e-04
Validation auc = 0.721457
Epoch 7528
Loss = 2.8422e-02, PNorm = 470.9786, GNorm = 0.5268, lr_0 = 9.9477e-04
Validation auc = 0.719780
Epoch 7529
Loss = 3.3560e-03, PNorm = 471.0021, GNorm = 0.3994, lr_0 = 9.9477e-04
Loss = 1.7530e-02, PNorm = 471.0219, GNorm = 1.3542, lr_0 = 9.9477e-04
Validation auc = 0.719297
Epoch 7530
Loss = 1.8368e-02, PNorm = 471.0468, GNorm = 0.1440, lr_0 = 9.9477e-04
Validation auc = 0.715533
Epoch 7531
Loss = 3.4530e-02, PNorm = 471.0767, GNorm = 0.0943, lr_0 = 9.9477e-04
Validation auc = 0.712749
Epoch 7532
Loss = 1.4513e-02, PNorm = 471.1030, GNorm = 1.1598, lr_0 = 9.9477e-04
Validation auc = 0.713211
Epoch 7533
Loss = 6.1940e-03, PNorm = 471.1233, GNorm = 0.0514, lr_0 = 9.9477e-04
Validation auc = 0.710834
Epoch 7534
Loss = 1.9465e-02, PNorm = 471.1395, GNorm = 0.8733, lr_0 = 9.9477e-04
Validation auc = 0.710174
Epoch 7535
Loss = 2.7194e-02, PNorm = 471.1587, GNorm = 0.4489, lr_0 = 9.9477e-04
Validation auc = 0.717005
Epoch 7536
Loss = 3.4887e-02, PNorm = 471.1870, GNorm = 1.9159, lr_0 = 9.9477e-04
Validation auc = 0.723246
Epoch 7537
Loss = 4.0047e-02, PNorm = 471.2223, GNorm = 0.2266, lr_0 = 9.9477e-04
Validation auc = 0.722046
Epoch 7538
Loss = 1.9859e-03, PNorm = 471.2495, GNorm = 0.2362, lr_0 = 9.9477e-04
Validation auc = 0.722812
Epoch 7539
Loss = 5.3540e-03, PNorm = 471.2706, GNorm = 0.2183, lr_0 = 9.9476e-04
Loss = 1.6320e-02, PNorm = 471.2884, GNorm = 0.0963, lr_0 = 9.9476e-04
Validation auc = 0.723227
Epoch 7540
Loss = 3.3754e-02, PNorm = 471.3084, GNorm = 1.1848, lr_0 = 9.9476e-04
Validation auc = 0.723454
Epoch 7541
Loss = 4.1256e-03, PNorm = 471.3383, GNorm = 0.0898, lr_0 = 9.9476e-04
Validation auc = 0.720879
Epoch 7542
Loss = 2.4945e-02, PNorm = 471.3640, GNorm = 1.8958, lr_0 = 9.9476e-04
Validation auc = 0.718491
Epoch 7543
Loss = 8.8091e-03, PNorm = 471.3985, GNorm = 0.0154, lr_0 = 9.9476e-04
Validation auc = 0.714642
Epoch 7544
Loss = 8.1967e-02, PNorm = 471.4264, GNorm = 0.0741, lr_0 = 9.9476e-04
Validation auc = 0.714500
Epoch 7545
Loss = 3.2750e-02, PNorm = 471.4507, GNorm = 2.2311, lr_0 = 9.9476e-04
Validation auc = 0.716172
Epoch 7546
Loss = 2.4154e-03, PNorm = 471.4734, GNorm = 0.1224, lr_0 = 9.9476e-04
Validation auc = 0.713698
Epoch 7547
Loss = 1.9174e-02, PNorm = 471.4939, GNorm = 0.1033, lr_0 = 9.9476e-04
Validation auc = 0.715119
Epoch 7548
Loss = 8.3044e-03, PNorm = 471.5095, GNorm = 0.1283, lr_0 = 9.9476e-04
Validation auc = 0.715789
Epoch 7549
Loss = 5.4652e-04, PNorm = 471.5270, GNorm = 0.0327, lr_0 = 9.9476e-04
Loss = 1.9812e-02, PNorm = 471.5475, GNorm = 1.6712, lr_0 = 9.9476e-04
Validation auc = 0.717423
Epoch 7550
Loss = 7.4599e-03, PNorm = 471.5717, GNorm = 0.2816, lr_0 = 9.9476e-04
Validation auc = 0.719287
Epoch 7551
Loss = 1.3587e-02, PNorm = 471.5904, GNorm = 1.4084, lr_0 = 9.9475e-04
Validation auc = 0.717959
Epoch 7552
Loss = 4.4906e-03, PNorm = 471.6073, GNorm = 0.0194, lr_0 = 9.9475e-04
Validation auc = 0.714725
Epoch 7553
Loss = 3.1641e-03, PNorm = 471.6194, GNorm = 0.0159, lr_0 = 9.9475e-04
Validation auc = 0.711274
Epoch 7554
Loss = 2.1471e-02, PNorm = 471.6271, GNorm = 0.0647, lr_0 = 9.9475e-04
Validation auc = 0.707696
Epoch 7555
Loss = 8.3509e-03, PNorm = 471.6406, GNorm = 0.0148, lr_0 = 9.9475e-04
Validation auc = 0.706938
Epoch 7556
Loss = 3.7150e-03, PNorm = 471.6520, GNorm = 0.0708, lr_0 = 9.9475e-04
Validation auc = 0.705963
Epoch 7557
Loss = 5.8003e-03, PNorm = 471.6613, GNorm = 0.5477, lr_0 = 9.9475e-04
Validation auc = 0.697924
Epoch 7558
Loss = 3.0112e-03, PNorm = 471.6780, GNorm = 0.0790, lr_0 = 9.9475e-04
Validation auc = 0.702813
Epoch 7559
Loss = 1.3771e-03, PNorm = 471.7015, GNorm = 0.0708, lr_0 = 9.9475e-04
Loss = 3.6463e-02, PNorm = 471.7266, GNorm = 0.1375, lr_0 = 9.9475e-04
Validation auc = 0.708061
Epoch 7560
Loss = 2.0515e-02, PNorm = 471.7509, GNorm = 0.6341, lr_0 = 9.9475e-04
Validation auc = 0.705449
Epoch 7561
Loss = 4.3405e-02, PNorm = 471.7878, GNorm = 0.3360, lr_0 = 9.9475e-04
Validation auc = 0.725433
Epoch 7562
Loss = 1.5830e-02, PNorm = 471.8272, GNorm = 0.6793, lr_0 = 9.9475e-04
Validation auc = 0.729970
Epoch 7563
Loss = 7.1729e-03, PNorm = 471.8527, GNorm = 0.1768, lr_0 = 9.9475e-04
Validation auc = 0.729667
Epoch 7564
Loss = 1.0028e-02, PNorm = 471.8715, GNorm = 0.7833, lr_0 = 9.9475e-04
Validation auc = 0.729413
Epoch 7565
Loss = 7.3389e-02, PNorm = 471.8958, GNorm = 0.8840, lr_0 = 9.9474e-04
Validation auc = 0.736095
Epoch 7566
Loss = 1.0819e-02, PNorm = 471.9281, GNorm = 1.1685, lr_0 = 9.9474e-04
Validation auc = 0.731306
Epoch 7567
Loss = 1.6782e-02, PNorm = 471.9578, GNorm = 0.0579, lr_0 = 9.9474e-04
Validation auc = 0.722147
Epoch 7568
Loss = 8.0847e-02, PNorm = 471.9875, GNorm = 0.0507, lr_0 = 9.9474e-04
Validation auc = 0.708612
Epoch 7569
Loss = 1.7306e-02, PNorm = 472.0195, GNorm = 1.4347, lr_0 = 9.9474e-04
Loss = 2.0826e-02, PNorm = 472.0461, GNorm = 0.5047, lr_0 = 9.9474e-04
Validation auc = 0.717715
Epoch 7570
Loss = 2.7343e-02, PNorm = 472.0706, GNorm = 1.7376, lr_0 = 9.9474e-04
Validation auc = 0.717697
Epoch 7571
Loss = 2.8152e-02, PNorm = 472.0938, GNorm = 1.5817, lr_0 = 9.9474e-04
Validation auc = 0.715090
Epoch 7572
Loss = 1.3071e-02, PNorm = 472.1225, GNorm = 0.1047, lr_0 = 9.9474e-04
Validation auc = 0.713937
Epoch 7573
Loss = 1.3719e-02, PNorm = 472.1476, GNorm = 0.3916, lr_0 = 9.9474e-04
Validation auc = 0.714019
Epoch 7574
Loss = 1.1766e-02, PNorm = 472.1690, GNorm = 0.0550, lr_0 = 9.9474e-04
Validation auc = 0.714836
Epoch 7575
Loss = 5.3943e-03, PNorm = 472.1924, GNorm = 0.0386, lr_0 = 9.9474e-04
Validation auc = 0.713060
Epoch 7576
Loss = 6.0060e-02, PNorm = 472.2134, GNorm = 2.5869, lr_0 = 9.9474e-04
Validation auc = 0.713947
Epoch 7577
Loss = 3.9901e-02, PNorm = 472.2376, GNorm = 1.1129, lr_0 = 9.9474e-04
Validation auc = 0.715667
Epoch 7578
Loss = 1.2035e-02, PNorm = 472.2601, GNorm = 0.4566, lr_0 = 9.9474e-04
Validation auc = 0.712670
Epoch 7579
Loss = 2.2236e-03, PNorm = 472.2886, GNorm = 0.0929, lr_0 = 9.9473e-04
Loss = 4.1783e-03, PNorm = 472.3089, GNorm = 0.5421, lr_0 = 9.9473e-04
Validation auc = 0.711240
Epoch 7580
Loss = 4.2902e-02, PNorm = 472.3379, GNorm = 0.4881, lr_0 = 9.9473e-04
Validation auc = 0.704548
Epoch 7581
Loss = 5.2616e-02, PNorm = 472.3799, GNorm = 0.3692, lr_0 = 9.9473e-04
Validation auc = 0.706861
Epoch 7582
Loss = 1.0889e-02, PNorm = 472.4131, GNorm = 0.2710, lr_0 = 9.9473e-04
Validation auc = 0.705817
Epoch 7583
Loss = 4.4633e-02, PNorm = 472.4387, GNorm = 6.9067, lr_0 = 9.9473e-04
Validation auc = 0.711688
Epoch 7584
Loss = 2.8131e-02, PNorm = 472.4737, GNorm = 0.8798, lr_0 = 9.9473e-04
Validation auc = 0.711570
Epoch 7585
Loss = 1.8476e-03, PNorm = 472.5121, GNorm = 0.1781, lr_0 = 9.9473e-04
Validation auc = 0.706311
Epoch 7586
Loss = 4.9371e-03, PNorm = 472.5368, GNorm = 0.5727, lr_0 = 9.9473e-04
Validation auc = 0.708292
Epoch 7587
Loss = 3.4855e-02, PNorm = 472.5552, GNorm = 1.4627, lr_0 = 9.9473e-04
Validation auc = 0.703155
Epoch 7588
Loss = 2.3382e-02, PNorm = 472.5821, GNorm = 0.5009, lr_0 = 9.9473e-04
Validation auc = 0.710247
Epoch 7589
Loss = 4.6859e-03, PNorm = 472.6065, GNorm = 0.3429, lr_0 = 9.9473e-04
Loss = 4.3549e-02, PNorm = 472.6282, GNorm = 1.1303, lr_0 = 9.9473e-04
Validation auc = 0.723063
Epoch 7590
Loss = 1.9157e-02, PNorm = 472.6550, GNorm = 0.8256, lr_0 = 9.9473e-04
Validation auc = 0.726540
Epoch 7591
Loss = 3.0280e-02, PNorm = 472.6791, GNorm = 2.1832, lr_0 = 9.9472e-04
Validation auc = 0.731045
Epoch 7592
Loss = 7.7519e-03, PNorm = 472.7074, GNorm = 0.7250, lr_0 = 9.9472e-04
Validation auc = 0.731451
Epoch 7593
Loss = 3.2816e-02, PNorm = 472.7297, GNorm = 6.6140, lr_0 = 9.9472e-04
Validation auc = 0.731370
Epoch 7594
Loss = 2.7570e-02, PNorm = 472.7542, GNorm = 0.0521, lr_0 = 9.9472e-04
Validation auc = 0.737661
Epoch 7595
Loss = 2.1018e-02, PNorm = 472.7779, GNorm = 0.6538, lr_0 = 9.9472e-04
Validation auc = 0.745097
Epoch 7596
Loss = 1.0572e-02, PNorm = 472.8060, GNorm = 1.1023, lr_0 = 9.9472e-04
Validation auc = 0.742241
Epoch 7597
Loss = 6.6812e-03, PNorm = 472.8268, GNorm = 1.1054, lr_0 = 9.9472e-04
Validation auc = 0.741348
Epoch 7598
Loss = 3.4145e-02, PNorm = 472.8439, GNorm = 0.1451, lr_0 = 9.9472e-04
Validation auc = 0.741770
Epoch 7599
Loss = 1.4492e-03, PNorm = 472.8655, GNorm = 0.1079, lr_0 = 9.9472e-04
Loss = 4.1314e-02, PNorm = 472.8839, GNorm = 1.9267, lr_0 = 9.9472e-04
Validation auc = 0.739771
Epoch 7600
Loss = 2.2898e-02, PNorm = 472.9119, GNorm = 0.1882, lr_0 = 9.9472e-04
Validation auc = 0.742697
Epoch 7601
Loss = 4.3110e-02, PNorm = 472.9374, GNorm = 1.4074, lr_0 = 9.9472e-04
Validation auc = 0.744790
Epoch 7602
Loss = 4.3887e-02, PNorm = 472.9644, GNorm = 0.8563, lr_0 = 9.9472e-04
Validation auc = 0.742427
Epoch 7603
Loss = 1.2247e-02, PNorm = 472.9928, GNorm = 0.3368, lr_0 = 9.9472e-04
Validation auc = 0.740157
Epoch 7604
Loss = 9.7835e-03, PNorm = 473.0128, GNorm = 0.2767, lr_0 = 9.9472e-04
Validation auc = 0.738258
Epoch 7605
Loss = 6.4192e-02, PNorm = 473.0292, GNorm = 0.9694, lr_0 = 9.9471e-04
Validation auc = 0.732670
Epoch 7606
Loss = 6.3349e-02, PNorm = 473.0458, GNorm = 1.6750, lr_0 = 9.9471e-04
Validation auc = 0.734129
Epoch 7607
Loss = 5.2271e-03, PNorm = 473.0680, GNorm = 0.1562, lr_0 = 9.9471e-04
Validation auc = 0.737808
Epoch 7608
Loss = 7.0994e-02, PNorm = 473.0889, GNorm = 4.3796, lr_0 = 9.9471e-04
Validation auc = 0.739905
Epoch 7609
Loss = 9.0268e-02, PNorm = 473.1156, GNorm = 1.2513, lr_0 = 9.9471e-04
Loss = 2.0814e-02, PNorm = 473.1464, GNorm = 0.0370, lr_0 = 9.9471e-04
Validation auc = 0.743120
Epoch 7610
Loss = 1.2160e-02, PNorm = 473.1706, GNorm = 0.3324, lr_0 = 9.9471e-04
Validation auc = 0.740317
Epoch 7611
Loss = 4.1933e-02, PNorm = 473.1903, GNorm = 0.9642, lr_0 = 9.9471e-04
Validation auc = 0.735413
Epoch 7612
Loss = 2.1162e-02, PNorm = 473.2158, GNorm = 0.1924, lr_0 = 9.9471e-04
Validation auc = 0.734792
Epoch 7613
Loss = 2.5920e-02, PNorm = 473.2376, GNorm = 0.0801, lr_0 = 9.9471e-04
Validation auc = 0.733134
Epoch 7614
Loss = 2.6573e-02, PNorm = 473.2612, GNorm = 1.6655, lr_0 = 9.9471e-04
Validation auc = 0.735408
Epoch 7615
Loss = 5.2984e-03, PNorm = 473.2812, GNorm = 0.0759, lr_0 = 9.9471e-04
Validation auc = 0.730441
Epoch 7616
Loss = 5.2387e-02, PNorm = 473.2965, GNorm = 1.1099, lr_0 = 9.9471e-04
Validation auc = 0.734365
Epoch 7617
Loss = 3.1130e-02, PNorm = 473.3190, GNorm = 2.1615, lr_0 = 9.9471e-04
Validation auc = 0.735151
Epoch 7618
Loss = 5.3808e-03, PNorm = 473.3458, GNorm = 0.4771, lr_0 = 9.9470e-04
Validation auc = 0.737645
Epoch 7619
Loss = 1.5618e-02, PNorm = 473.3794, GNorm = 1.0248, lr_0 = 9.9470e-04
Loss = 1.5908e-02, PNorm = 473.4129, GNorm = 0.1996, lr_0 = 9.9470e-04
Validation auc = 0.731628
Epoch 7620
Loss = 3.6292e-02, PNorm = 473.4406, GNorm = 1.7733, lr_0 = 9.9470e-04
Validation auc = 0.733739
Epoch 7621
Loss = 3.3734e-02, PNorm = 473.4751, GNorm = 0.0674, lr_0 = 9.9470e-04
Validation auc = 0.738911
Epoch 7622
Loss = 4.4100e-02, PNorm = 473.5054, GNorm = 3.0465, lr_0 = 9.9470e-04
Validation auc = 0.737026
Epoch 7623
Loss = 1.4587e-02, PNorm = 473.5303, GNorm = 1.0922, lr_0 = 9.9470e-04
Validation auc = 0.730463
Epoch 7624
Loss = 9.8438e-03, PNorm = 473.5537, GNorm = 1.3546, lr_0 = 9.9470e-04
Validation auc = 0.721766
Epoch 7625
Loss = 5.4955e-02, PNorm = 473.5811, GNorm = 1.9689, lr_0 = 9.9470e-04
Validation auc = 0.725803
Epoch 7626
Loss = 2.3254e-02, PNorm = 473.6235, GNorm = 1.2791, lr_0 = 9.9470e-04
Validation auc = 0.729689
Epoch 7627
Loss = 1.0010e-02, PNorm = 473.6655, GNorm = 0.6357, lr_0 = 9.9470e-04
Validation auc = 0.733194
Epoch 7628
Loss = 3.7277e-02, PNorm = 473.6953, GNorm = 2.5119, lr_0 = 9.9470e-04
Validation auc = 0.730693
Epoch 7629
Loss = 3.5423e-03, PNorm = 473.7186, GNorm = 0.2165, lr_0 = 9.9470e-04
Loss = 1.6325e-02, PNorm = 473.7465, GNorm = 0.1261, lr_0 = 9.9470e-04
Validation auc = 0.733179
Epoch 7630
Loss = 5.1183e-02, PNorm = 473.7740, GNorm = 1.7829, lr_0 = 9.9470e-04
Validation auc = 0.726666
Epoch 7631
Loss = 9.5446e-03, PNorm = 473.8051, GNorm = 1.1630, lr_0 = 9.9469e-04
Validation auc = 0.731364
Epoch 7632
Loss = 7.1283e-02, PNorm = 473.8309, GNorm = 0.5444, lr_0 = 9.9469e-04
Validation auc = 0.725348
Epoch 7633
Loss = 8.1302e-02, PNorm = 473.8786, GNorm = 4.3689, lr_0 = 9.9469e-04
Validation auc = 0.723935
Epoch 7634
Loss = 1.1478e-02, PNorm = 473.9409, GNorm = 0.0892, lr_0 = 9.9469e-04
Validation auc = 0.728924
Epoch 7635
Loss = 5.0122e-02, PNorm = 473.9881, GNorm = 2.5096, lr_0 = 9.9469e-04
Validation auc = 0.736273
Epoch 7636
Loss = 2.4071e-02, PNorm = 474.0329, GNorm = 0.4302, lr_0 = 9.9469e-04
Validation auc = 0.739579
Epoch 7637
Loss = 4.9557e-03, PNorm = 474.0812, GNorm = 1.2002, lr_0 = 9.9469e-04
Validation auc = 0.737032
Epoch 7638
Loss = 3.7007e-02, PNorm = 474.1193, GNorm = 0.0740, lr_0 = 9.9469e-04
Validation auc = 0.726824
Epoch 7639
Loss = 1.3377e-01, PNorm = 474.1506, GNorm = 1.8841, lr_0 = 9.9469e-04
Loss = 2.3238e-02, PNorm = 474.1853, GNorm = 0.4101, lr_0 = 9.9469e-04
Validation auc = 0.726587
Epoch 7640
Loss = 3.1145e-02, PNorm = 474.2152, GNorm = 0.9757, lr_0 = 9.9469e-04
Validation auc = 0.731979
Epoch 7641
Loss = 3.9245e-02, PNorm = 474.2462, GNorm = 0.8431, lr_0 = 9.9469e-04
Validation auc = 0.728472
Epoch 7642
Loss = 1.6715e-02, PNorm = 474.2766, GNorm = 0.1034, lr_0 = 9.9469e-04
Validation auc = 0.730776
Epoch 7643
Loss = 1.0123e-02, PNorm = 474.3026, GNorm = 1.1857, lr_0 = 9.9469e-04
Validation auc = 0.731409
Epoch 7644
Loss = 1.8245e-02, PNorm = 474.3309, GNorm = 0.0958, lr_0 = 9.9469e-04
Validation auc = 0.736595
Epoch 7645
Loss = 4.9199e-02, PNorm = 474.3673, GNorm = 0.2645, lr_0 = 9.9468e-04
Validation auc = 0.735320
Epoch 7646
Loss = 4.8380e-02, PNorm = 474.4055, GNorm = 1.5257, lr_0 = 9.9468e-04
Validation auc = 0.722137
Epoch 7647
Loss = 5.2601e-03, PNorm = 474.4483, GNorm = 0.5682, lr_0 = 9.9468e-04
Validation auc = 0.712617
Epoch 7648
Loss = 1.2826e-02, PNorm = 474.4856, GNorm = 0.2957, lr_0 = 9.9468e-04
Validation auc = 0.715630
Epoch 7649
Loss = 3.7616e-02, PNorm = 474.5181, GNorm = 2.1420, lr_0 = 9.9468e-04
Loss = 2.8174e-02, PNorm = 474.5538, GNorm = 2.7072, lr_0 = 9.9468e-04
Validation auc = 0.718053
Epoch 7650
Loss = 1.6171e-02, PNorm = 474.5822, GNorm = 0.0540, lr_0 = 9.9468e-04
Validation auc = 0.711833
Epoch 7651
Loss = 2.7970e-02, PNorm = 474.6065, GNorm = 1.2312, lr_0 = 9.9468e-04
Validation auc = 0.712160
Epoch 7652
Loss = 2.9367e-02, PNorm = 474.6355, GNorm = 1.8821, lr_0 = 9.9468e-04
Validation auc = 0.716631
Epoch 7653
Loss = 4.6516e-02, PNorm = 474.6662, GNorm = 2.4296, lr_0 = 9.9468e-04
Validation auc = 0.718988
Epoch 7654
Loss = 4.8237e-02, PNorm = 474.7015, GNorm = 0.4090, lr_0 = 9.9468e-04
Validation auc = 0.712910
Epoch 7655
Loss = 8.5397e-02, PNorm = 474.7447, GNorm = 0.2742, lr_0 = 9.9468e-04
Validation auc = 0.707713
Epoch 7656
Loss = 1.4902e-02, PNorm = 474.7918, GNorm = 0.2662, lr_0 = 9.9468e-04
Validation auc = 0.702424
Epoch 7657
Loss = 7.2838e-02, PNorm = 474.8347, GNorm = 0.4535, lr_0 = 9.9468e-04
Validation auc = 0.706366
Epoch 7658
Loss = 3.3203e-02, PNorm = 474.8911, GNorm = 0.1600, lr_0 = 9.9467e-04
Validation auc = 0.704747
Epoch 7659
Loss = 2.8021e-02, PNorm = 474.9371, GNorm = 0.8068, lr_0 = 9.9467e-04
Loss = 1.6551e-02, PNorm = 474.9785, GNorm = 0.2498, lr_0 = 9.9467e-04
Validation auc = 0.708876
Epoch 7660
Loss = 2.4676e-02, PNorm = 475.0130, GNorm = 2.9097, lr_0 = 9.9467e-04
Validation auc = 0.714111
Epoch 7661
Loss = 7.2147e-02, PNorm = 475.0452, GNorm = 7.7375, lr_0 = 9.9467e-04
Validation auc = 0.716727
Epoch 7662
Loss = 2.4828e-02, PNorm = 475.0899, GNorm = 0.1785, lr_0 = 9.9467e-04
Validation auc = 0.713384
Epoch 7663
Loss = 2.6717e-02, PNorm = 475.1268, GNorm = 1.3366, lr_0 = 9.9467e-04
Validation auc = 0.709577
Epoch 7664
Loss = 2.1264e-02, PNorm = 475.1611, GNorm = 0.8201, lr_0 = 9.9467e-04
Validation auc = 0.703793
Epoch 7665
Loss = 1.8862e-02, PNorm = 475.1862, GNorm = 0.9108, lr_0 = 9.9467e-04
Validation auc = 0.702007
Epoch 7666
Loss = 7.8253e-03, PNorm = 475.2026, GNorm = 0.0989, lr_0 = 9.9467e-04
Validation auc = 0.698582
Epoch 7667
Loss = 2.7429e-02, PNorm = 475.2235, GNorm = 0.4388, lr_0 = 9.9467e-04
Validation auc = 0.694886
Epoch 7668
Loss = 1.6044e-02, PNorm = 475.2500, GNorm = 0.4405, lr_0 = 9.9467e-04
Validation auc = 0.701879
Epoch 7669
Loss = 1.5000e-01, PNorm = 475.2761, GNorm = 2.0458, lr_0 = 9.9467e-04
Loss = 7.1515e-03, PNorm = 475.2985, GNorm = 0.3193, lr_0 = 9.9467e-04
Validation auc = 0.701977
Epoch 7670
Loss = 2.7803e-02, PNorm = 475.3162, GNorm = 0.6258, lr_0 = 9.9467e-04
Validation auc = 0.702096
Epoch 7671
Loss = 2.7041e-02, PNorm = 475.3386, GNorm = 0.0515, lr_0 = 9.9466e-04
Validation auc = 0.706063
Epoch 7672
Loss = 2.7009e-02, PNorm = 475.3655, GNorm = 0.0494, lr_0 = 9.9466e-04
Validation auc = 0.717559
Epoch 7673
Loss = 6.2968e-02, PNorm = 475.3923, GNorm = 4.0217, lr_0 = 9.9466e-04
Validation auc = 0.718049
Epoch 7674
Loss = 9.3066e-03, PNorm = 475.4232, GNorm = 0.1596, lr_0 = 9.9466e-04
Validation auc = 0.716538
Epoch 7675
Loss = 3.8432e-02, PNorm = 475.4511, GNorm = 0.1117, lr_0 = 9.9466e-04
Validation auc = 0.718026
Epoch 7676
Loss = 2.5892e-02, PNorm = 475.4778, GNorm = 0.3915, lr_0 = 9.9466e-04
Validation auc = 0.717201
Epoch 7677
Loss = 7.1444e-03, PNorm = 475.5051, GNorm = 0.1035, lr_0 = 9.9466e-04
Validation auc = 0.722660
Epoch 7678
Loss = 3.0653e-03, PNorm = 475.5336, GNorm = 0.3188, lr_0 = 9.9466e-04
Validation auc = 0.725750
Epoch 7679
Loss = 3.4001e-02, PNorm = 475.5654, GNorm = 1.2493, lr_0 = 9.9466e-04
Loss = 4.9494e-02, PNorm = 475.5914, GNorm = 1.5130, lr_0 = 9.9466e-04
Validation auc = 0.733439
Epoch 7680
Loss = 2.7510e-02, PNorm = 475.6261, GNorm = 0.0921, lr_0 = 9.9466e-04
Validation auc = 0.742709
Epoch 7681
Loss = 7.1547e-03, PNorm = 475.6524, GNorm = 0.0926, lr_0 = 9.9466e-04
Validation auc = 0.747703
Epoch 7682
Loss = 2.1853e-02, PNorm = 475.6711, GNorm = 0.0575, lr_0 = 9.9466e-04
Validation auc = 0.743716
Epoch 7683
Loss = 1.7797e-02, PNorm = 475.6966, GNorm = 0.8319, lr_0 = 9.9466e-04
Validation auc = 0.742130
Epoch 7684
Loss = 1.7736e-02, PNorm = 475.7252, GNorm = 0.0656, lr_0 = 9.9465e-04
Validation auc = 0.745079
Epoch 7685
Loss = 1.0857e-02, PNorm = 475.7533, GNorm = 1.3923, lr_0 = 9.9465e-04
Validation auc = 0.744149
Epoch 7686
Loss = 2.2359e-02, PNorm = 475.7841, GNorm = 0.5387, lr_0 = 9.9465e-04
Validation auc = 0.746839
Epoch 7687
Loss = 2.2876e-02, PNorm = 475.8222, GNorm = 0.2156, lr_0 = 9.9465e-04
Validation auc = 0.744615
Epoch 7688
Loss = 6.0177e-02, PNorm = 475.8622, GNorm = 0.5358, lr_0 = 9.9465e-04
Validation auc = 0.741094
Epoch 7689
Loss = 7.6133e-02, PNorm = 475.8970, GNorm = 1.0954, lr_0 = 9.9465e-04
Loss = 3.9041e-02, PNorm = 475.9258, GNorm = 0.8501, lr_0 = 9.9465e-04
Validation auc = 0.739208
Epoch 7690
Loss = 4.6132e-03, PNorm = 475.9509, GNorm = 0.2089, lr_0 = 9.9465e-04
Validation auc = 0.739431
Epoch 7691
Loss = 3.3597e-02, PNorm = 475.9656, GNorm = 1.1401, lr_0 = 9.9465e-04
Validation auc = 0.741412
Epoch 7692
Loss = 4.7113e-02, PNorm = 475.9881, GNorm = 0.9485, lr_0 = 9.9465e-04
Validation auc = 0.738887
Epoch 7693
Loss = 2.4696e-02, PNorm = 476.0174, GNorm = 1.8786, lr_0 = 9.9465e-04
Validation auc = 0.734037
Epoch 7694
Loss = 9.4619e-03, PNorm = 476.0511, GNorm = 0.1445, lr_0 = 9.9465e-04
Validation auc = 0.736025
Epoch 7695
Loss = 4.8251e-03, PNorm = 476.0767, GNorm = 0.7002, lr_0 = 9.9465e-04
Validation auc = 0.737398
Epoch 7696
Loss = 2.2053e-02, PNorm = 476.0949, GNorm = 0.0808, lr_0 = 9.9465e-04
Validation auc = 0.734973
Epoch 7697
Loss = 8.5080e-03, PNorm = 476.1093, GNorm = 0.7079, lr_0 = 9.9465e-04
Validation auc = 0.732202
Epoch 7698
Loss = 1.8057e-02, PNorm = 476.1223, GNorm = 0.0119, lr_0 = 9.9464e-04
Validation auc = 0.729686
Epoch 7699
Loss = 1.6821e-03, PNorm = 476.1405, GNorm = 0.0639, lr_0 = 9.9464e-04
Loss = 3.1086e-02, PNorm = 476.1570, GNorm = 7.1863, lr_0 = 9.9464e-04
Validation auc = 0.728092
Epoch 7700
Loss = 1.0655e-02, PNorm = 476.1763, GNorm = 0.1141, lr_0 = 9.9464e-04
Validation auc = 0.729058
Epoch 7701
Loss = 2.8556e-02, PNorm = 476.1960, GNorm = 0.6045, lr_0 = 9.9464e-04
Validation auc = 0.729521
Epoch 7702
Loss = 1.1273e-02, PNorm = 476.2227, GNorm = 2.1202, lr_0 = 9.9464e-04
Validation auc = 0.728121
Epoch 7703
Loss = 2.1872e-02, PNorm = 476.2428, GNorm = 0.3977, lr_0 = 9.9464e-04
Validation auc = 0.729458
Epoch 7704
Loss = 1.3572e-02, PNorm = 476.2775, GNorm = 0.7587, lr_0 = 9.9464e-04
Validation auc = 0.725083
Epoch 7705
Loss = 3.9480e-02, PNorm = 476.3183, GNorm = 2.7164, lr_0 = 9.9464e-04
Validation auc = 0.721353
Epoch 7706
Loss = 2.6501e-02, PNorm = 476.3569, GNorm = 0.7316, lr_0 = 9.9464e-04
Validation auc = 0.710723
Epoch 7707
Loss = 4.3546e-02, PNorm = 476.3942, GNorm = 1.0378, lr_0 = 9.9464e-04
Validation auc = 0.714989
Epoch 7708
Loss = 7.4979e-03, PNorm = 476.4288, GNorm = 0.0702, lr_0 = 9.9464e-04
Validation auc = 0.719144
Epoch 7709
Loss = 5.6797e-02, PNorm = 476.4642, GNorm = 1.0258, lr_0 = 9.9464e-04
Loss = 4.0761e-02, PNorm = 476.5015, GNorm = 0.2019, lr_0 = 9.9464e-04
Validation auc = 0.725433
Epoch 7710
Loss = 2.6655e-02, PNorm = 476.5352, GNorm = 0.1596, lr_0 = 9.9464e-04
Validation auc = 0.729053
Epoch 7711
Loss = 3.4208e-02, PNorm = 476.5574, GNorm = 0.1221, lr_0 = 9.9463e-04
Validation auc = 0.727179
Epoch 7712
Loss = 1.5267e-02, PNorm = 476.5822, GNorm = 0.6545, lr_0 = 9.9463e-04
Validation auc = 0.724759
Epoch 7713
Loss = 1.5305e-02, PNorm = 476.6065, GNorm = 0.1680, lr_0 = 9.9463e-04
Validation auc = 0.727443
Epoch 7714
Loss = 2.0984e-02, PNorm = 476.6281, GNorm = 1.5319, lr_0 = 9.9463e-04
Validation auc = 0.727340
Epoch 7715
Loss = 1.1764e-02, PNorm = 476.6578, GNorm = 0.2072, lr_0 = 9.9463e-04
Validation auc = 0.721955
Epoch 7716
Loss = 1.2994e-02, PNorm = 476.6945, GNorm = 0.3639, lr_0 = 9.9463e-04
Validation auc = 0.723844
Epoch 7717
Loss = 7.3110e-03, PNorm = 476.7282, GNorm = 0.3602, lr_0 = 9.9463e-04
Validation auc = 0.727261
Epoch 7718
Loss = 1.1241e-02, PNorm = 476.7498, GNorm = 1.8307, lr_0 = 9.9463e-04
Validation auc = 0.731244
Epoch 7719
Loss = 5.2794e-03, PNorm = 476.7706, GNorm = 1.0616, lr_0 = 9.9463e-04
Loss = 8.0374e-02, PNorm = 476.8039, GNorm = 0.3470, lr_0 = 9.9463e-04
Validation auc = 0.721168
Epoch 7720
Loss = 4.9355e-02, PNorm = 476.8544, GNorm = 0.2280, lr_0 = 9.9463e-04
Validation auc = 0.708855
Epoch 7721
Loss = 3.0123e-02, PNorm = 476.9040, GNorm = 2.6934, lr_0 = 9.9463e-04
Validation auc = 0.697187
Epoch 7722
Loss = 1.0686e-02, PNorm = 476.9405, GNorm = 0.0608, lr_0 = 9.9463e-04
Validation auc = 0.697802
Epoch 7723
Loss = 1.6639e-02, PNorm = 476.9687, GNorm = 0.3607, lr_0 = 9.9463e-04
Validation auc = 0.708085
Epoch 7724
Loss = 2.5543e-02, PNorm = 476.9999, GNorm = 2.4664, lr_0 = 9.9462e-04
Validation auc = 0.712529
Epoch 7725
Loss = 3.4140e-02, PNorm = 477.0311, GNorm = 0.2524, lr_0 = 9.9462e-04
Validation auc = 0.711125
Epoch 7726
Loss = 2.4481e-02, PNorm = 477.0601, GNorm = 0.0878, lr_0 = 9.9462e-04
Validation auc = 0.710983
Epoch 7727
Loss = 2.6209e-02, PNorm = 477.0876, GNorm = 0.2467, lr_0 = 9.9462e-04
Validation auc = 0.709055
Epoch 7728
Loss = 4.8432e-02, PNorm = 477.1176, GNorm = 1.2117, lr_0 = 9.9462e-04
Validation auc = 0.711264
Epoch 7729
Loss = 2.8585e-02, PNorm = 477.1469, GNorm = 1.6999, lr_0 = 9.9462e-04
Loss = 4.1718e-02, PNorm = 477.1765, GNorm = 0.6011, lr_0 = 9.9462e-04
Validation auc = 0.714019
Epoch 7730
Loss = 4.4874e-02, PNorm = 477.2146, GNorm = 0.1652, lr_0 = 9.9462e-04
Validation auc = 0.719187
Epoch 7731
Loss = 5.1056e-02, PNorm = 477.2573, GNorm = 1.5553, lr_0 = 9.9462e-04
Validation auc = 0.718479
Epoch 7732
Loss = 1.8765e-02, PNorm = 477.3014, GNorm = 0.2581, lr_0 = 9.9462e-04
Validation auc = 0.711355
Epoch 7733
Loss = 4.2872e-02, PNorm = 477.3359, GNorm = 0.2657, lr_0 = 9.9462e-04
Validation auc = 0.705041
Epoch 7734
Loss = 3.3576e-02, PNorm = 477.3687, GNorm = 3.1975, lr_0 = 9.9462e-04
Validation auc = 0.698282
Epoch 7735
Loss = 1.5691e-02, PNorm = 477.4041, GNorm = 0.6917, lr_0 = 9.9462e-04
Validation auc = 0.702642
Epoch 7736
Loss = 3.3118e-03, PNorm = 477.4319, GNorm = 0.1143, lr_0 = 9.9462e-04
Validation auc = 0.706343
Epoch 7737
Loss = 4.3240e-02, PNorm = 477.4551, GNorm = 0.1973, lr_0 = 9.9462e-04
Validation auc = 0.718679
Epoch 7738
Loss = 1.0015e-02, PNorm = 477.4888, GNorm = 0.4987, lr_0 = 9.9461e-04
Validation auc = 0.723256
Epoch 7739
Loss = 3.3561e-02, PNorm = 477.5244, GNorm = 2.3023, lr_0 = 9.9461e-04
Loss = 4.7706e-02, PNorm = 477.5584, GNorm = 3.4177, lr_0 = 9.9461e-04
Validation auc = 0.726587
Epoch 7740
Loss = 1.7802e-02, PNorm = 477.5973, GNorm = 0.9396, lr_0 = 9.9461e-04
Validation auc = 0.721396
Epoch 7741
Loss = 2.6106e-02, PNorm = 477.6329, GNorm = 1.6318, lr_0 = 9.9461e-04
Validation auc = 0.718783
Epoch 7742
Loss = 1.5044e-02, PNorm = 477.6704, GNorm = 1.3359, lr_0 = 9.9461e-04
Validation auc = 0.717348
Epoch 7743
Loss = 4.1764e-02, PNorm = 477.7058, GNorm = 2.8922, lr_0 = 9.9461e-04
Validation auc = 0.718035
Epoch 7744
Loss = 1.5812e-02, PNorm = 477.7523, GNorm = 1.0708, lr_0 = 9.9461e-04
Validation auc = 0.723468
Epoch 7745
Loss = 5.0135e-03, PNorm = 477.7912, GNorm = 0.2476, lr_0 = 9.9461e-04
Validation auc = 0.722757
Epoch 7746
Loss = 4.5062e-03, PNorm = 477.8175, GNorm = 0.1084, lr_0 = 9.9461e-04
Validation auc = 0.718553
Epoch 7747
Loss = 2.6121e-02, PNorm = 477.8419, GNorm = 0.2931, lr_0 = 9.9461e-04
Validation auc = 0.717377
Epoch 7748
Loss = 6.0958e-03, PNorm = 477.8634, GNorm = 0.3272, lr_0 = 9.9461e-04
Validation auc = 0.714633
Epoch 7749
Loss = 2.2987e-01, PNorm = 477.8882, GNorm = 5.6697, lr_0 = 9.9461e-04
Loss = 2.8887e-02, PNorm = 477.9450, GNorm = 0.8788, lr_0 = 9.9461e-04
Validation auc = 0.719175
Epoch 7750
Loss = 1.0159e-02, PNorm = 477.9833, GNorm = 0.0722, lr_0 = 9.9460e-04
Validation auc = 0.718261
Epoch 7751
Loss = 2.3445e-02, PNorm = 478.0086, GNorm = 0.2793, lr_0 = 9.9460e-04
Validation auc = 0.712043
Epoch 7752
Loss = 5.4244e-02, PNorm = 478.0307, GNorm = 0.0937, lr_0 = 9.9460e-04
Validation auc = 0.714521
Epoch 7753
Loss = 1.8295e-02, PNorm = 478.0535, GNorm = 1.1792, lr_0 = 9.9460e-04
Validation auc = 0.713854
Epoch 7754
Loss = 2.2868e-02, PNorm = 478.0823, GNorm = 0.6651, lr_0 = 9.9460e-04
Validation auc = 0.712975
Epoch 7755
Loss = 5.8322e-02, PNorm = 478.1153, GNorm = 0.1376, lr_0 = 9.9460e-04
Validation auc = 0.723003
Epoch 7756
Loss = 4.0919e-02, PNorm = 478.1487, GNorm = 1.8045, lr_0 = 9.9460e-04
Validation auc = 0.719469
Epoch 7757
Loss = 6.1902e-02, PNorm = 478.1892, GNorm = 1.3838, lr_0 = 9.9460e-04
Validation auc = 0.720462
Epoch 7758
Loss = 1.7709e-02, PNorm = 478.2188, GNorm = 0.5147, lr_0 = 9.9460e-04
Validation auc = 0.724719
Epoch 7759
Loss = 2.3520e-02, PNorm = 478.2481, GNorm = 0.7320, lr_0 = 9.9460e-04
Loss = 2.4150e-02, PNorm = 478.2742, GNorm = 2.3566, lr_0 = 9.9460e-04
Validation auc = 0.723524
Epoch 7760
Loss = 1.9234e-02, PNorm = 478.2976, GNorm = 0.6465, lr_0 = 9.9460e-04
Validation auc = 0.727195
Epoch 7761
Loss = 2.4397e-02, PNorm = 478.3314, GNorm = 0.4343, lr_0 = 9.9460e-04
Validation auc = 0.730609
Epoch 7762
Loss = 5.7065e-02, PNorm = 478.3704, GNorm = 0.5567, lr_0 = 9.9460e-04
Validation auc = 0.731993
Epoch 7763
Loss = 4.4032e-02, PNorm = 478.4124, GNorm = 2.7200, lr_0 = 9.9460e-04
Validation auc = 0.740348
Epoch 7764
Loss = 8.8011e-03, PNorm = 478.4504, GNorm = 0.7992, lr_0 = 9.9459e-04
Validation auc = 0.737781
Epoch 7765
Loss = 8.1510e-03, PNorm = 478.4814, GNorm = 0.1801, lr_0 = 9.9459e-04
Validation auc = 0.733675
Epoch 7766
Loss = 5.2721e-02, PNorm = 478.5080, GNorm = 1.9957, lr_0 = 9.9459e-04
Validation auc = 0.733130
Epoch 7767
Loss = 6.6882e-03, PNorm = 478.5375, GNorm = 0.1462, lr_0 = 9.9459e-04
Validation auc = 0.730552
Epoch 7768
Loss = 9.7595e-03, PNorm = 478.5629, GNorm = 0.4338, lr_0 = 9.9459e-04
Validation auc = 0.733552
Epoch 7769
Loss = 8.3260e-03, PNorm = 478.5882, GNorm = 0.4340, lr_0 = 9.9459e-04
Loss = 3.1054e-02, PNorm = 478.6103, GNorm = 0.0769, lr_0 = 9.9459e-04
Validation auc = 0.731853
Epoch 7770
Loss = 2.9611e-02, PNorm = 478.6294, GNorm = 1.4646, lr_0 = 9.9459e-04
Validation auc = 0.728156
Epoch 7771
Loss = 2.2889e-02, PNorm = 478.6521, GNorm = 0.3886, lr_0 = 9.9459e-04
Validation auc = 0.727601
Epoch 7772
Loss = 1.5063e-02, PNorm = 478.6756, GNorm = 0.6554, lr_0 = 9.9459e-04
Validation auc = 0.729736
Epoch 7773
Loss = 7.7771e-03, PNorm = 478.6937, GNorm = 0.8649, lr_0 = 9.9459e-04
Validation auc = 0.727107
Epoch 7774
Loss = 3.7827e-02, PNorm = 478.7081, GNorm = 4.9558, lr_0 = 9.9459e-04
Validation auc = 0.731628
Epoch 7775
Loss = 4.2147e-02, PNorm = 478.7293, GNorm = 1.3848, lr_0 = 9.9459e-04
Validation auc = 0.728621
Epoch 7776
Loss = 1.0890e-02, PNorm = 478.7581, GNorm = 0.0472, lr_0 = 9.9459e-04
Validation auc = 0.728489
Epoch 7777
Loss = 9.6451e-03, PNorm = 478.7907, GNorm = 0.2258, lr_0 = 9.9459e-04
Validation auc = 0.728960
Epoch 7778
Loss = 4.1639e-03, PNorm = 478.8224, GNorm = 0.4287, lr_0 = 9.9458e-04
Validation auc = 0.724640
Epoch 7779
Loss = 4.2210e-04, PNorm = 478.8501, GNorm = 0.0267, lr_0 = 9.9458e-04
Loss = 5.4293e-02, PNorm = 478.8845, GNorm = 1.1979, lr_0 = 9.9458e-04
Validation auc = 0.726305
Epoch 7780
Loss = 2.9984e-02, PNorm = 478.9199, GNorm = 1.8072, lr_0 = 9.9458e-04
Validation auc = 0.722139
Epoch 7781
Loss = 2.6650e-02, PNorm = 478.9518, GNorm = 2.1437, lr_0 = 9.9458e-04
Validation auc = 0.720342
Epoch 7782
Loss = 3.7969e-02, PNorm = 478.9843, GNorm = 2.5905, lr_0 = 9.9458e-04
Validation auc = 0.713190
Epoch 7783
Loss = 3.4959e-02, PNorm = 479.0206, GNorm = 0.9057, lr_0 = 9.9458e-04
Validation auc = 0.723507
Epoch 7784
Loss = 2.2117e-02, PNorm = 479.0526, GNorm = 1.9332, lr_0 = 9.9458e-04
Validation auc = 0.723812
Epoch 7785
Loss = 4.4962e-02, PNorm = 479.0792, GNorm = 0.0439, lr_0 = 9.9458e-04
Validation auc = 0.733358
Epoch 7786
Loss = 5.0450e-03, PNorm = 479.1060, GNorm = 0.1464, lr_0 = 9.9458e-04
Validation auc = 0.732011
Epoch 7787
Loss = 9.6687e-03, PNorm = 479.1295, GNorm = 0.0852, lr_0 = 9.9458e-04
Validation auc = 0.732857
Epoch 7788
Loss = 3.9600e-03, PNorm = 479.1554, GNorm = 0.0911, lr_0 = 9.9458e-04
Validation auc = 0.732918
Epoch 7789
Loss = 1.1161e-02, PNorm = 479.1919, GNorm = 0.4379, lr_0 = 9.9458e-04
Loss = 2.0787e-02, PNorm = 479.2251, GNorm = 0.2315, lr_0 = 9.9458e-04
Validation auc = 0.742033
Epoch 7790
Loss = 1.9755e-02, PNorm = 479.2494, GNorm = 0.5363, lr_0 = 9.9457e-04
Validation auc = 0.736297
Epoch 7791
Loss = 4.8180e-02, PNorm = 479.2759, GNorm = 0.9824, lr_0 = 9.9457e-04
Validation auc = 0.744241
Epoch 7792
Loss = 5.7695e-02, PNorm = 479.3182, GNorm = 0.6108, lr_0 = 9.9457e-04
Validation auc = 0.736988
Epoch 7793
Loss = 2.5000e-02, PNorm = 479.3548, GNorm = 1.2956, lr_0 = 9.9457e-04
Validation auc = 0.733728
Epoch 7794
Loss = 8.7431e-03, PNorm = 479.3801, GNorm = 0.0262, lr_0 = 9.9457e-04
Validation auc = 0.734266
Epoch 7795
Loss = 5.9873e-03, PNorm = 479.3968, GNorm = 0.1600, lr_0 = 9.9457e-04
Validation auc = 0.734695
Epoch 7796
Loss = 1.4318e-02, PNorm = 479.4141, GNorm = 0.1306, lr_0 = 9.9457e-04
Validation auc = 0.733004
Epoch 7797
Loss = 2.1331e-02, PNorm = 479.4374, GNorm = 0.9535, lr_0 = 9.9457e-04
Validation auc = 0.724164
Epoch 7798
Loss = 3.8514e-03, PNorm = 479.4629, GNorm = 0.2305, lr_0 = 9.9457e-04
Validation auc = 0.715955
Epoch 7799
Loss = 5.8006e-02, PNorm = 479.4822, GNorm = 0.7753, lr_0 = 9.9457e-04
Loss = 1.8457e-02, PNorm = 479.5019, GNorm = 1.6485, lr_0 = 9.9457e-04
Validation auc = 0.716839
Epoch 7800
Loss = 2.6758e-02, PNorm = 479.5265, GNorm = 2.9856, lr_0 = 9.9457e-04
Validation auc = 0.719867
Epoch 7801
Loss = 1.3399e-02, PNorm = 479.5531, GNorm = 1.8196, lr_0 = 9.9457e-04
Validation auc = 0.720917
Epoch 7802
Loss = 3.9054e-02, PNorm = 479.5799, GNorm = 3.6833, lr_0 = 9.9457e-04
Validation auc = 0.718805
Epoch 7803
Loss = 2.9161e-02, PNorm = 479.6212, GNorm = 2.7661, lr_0 = 9.9457e-04
Validation auc = 0.723185
Epoch 7804
Loss = 3.2290e-02, PNorm = 479.6660, GNorm = 0.5287, lr_0 = 9.9456e-04
Validation auc = 0.714344
Epoch 7805
Loss = 4.8600e-02, PNorm = 479.7092, GNorm = 0.2457, lr_0 = 9.9456e-04
Validation auc = 0.706586
Epoch 7806
Loss = 2.5570e-02, PNorm = 479.7523, GNorm = 0.0275, lr_0 = 9.9456e-04
Validation auc = 0.702320
Epoch 7807
Loss = 3.2631e-02, PNorm = 479.7858, GNorm = 1.0447, lr_0 = 9.9456e-04
Validation auc = 0.702162
Epoch 7808
Loss = 3.8279e-02, PNorm = 479.8119, GNorm = 1.2904, lr_0 = 9.9456e-04
Validation auc = 0.704235
Epoch 7809
Loss = 4.0529e-02, PNorm = 479.8422, GNorm = 1.3150, lr_0 = 9.9456e-04
Loss = 7.0531e-03, PNorm = 479.8711, GNorm = 0.3685, lr_0 = 9.9456e-04
Validation auc = 0.704559
Epoch 7810
Loss = 4.0972e-02, PNorm = 479.8985, GNorm = 1.0549, lr_0 = 9.9456e-04
Validation auc = 0.707516
Epoch 7811
Loss = 2.3148e-02, PNorm = 479.9392, GNorm = 0.8936, lr_0 = 9.9456e-04
Validation auc = 0.712797
Epoch 7812
Loss = 3.2091e-02, PNorm = 479.9808, GNorm = 0.1131, lr_0 = 9.9456e-04
Validation auc = 0.712667
Epoch 7813
Loss = 1.4093e-02, PNorm = 480.0132, GNorm = 0.7956, lr_0 = 9.9456e-04
Validation auc = 0.718387
Epoch 7814
Loss = 3.0706e-02, PNorm = 480.0394, GNorm = 1.5201, lr_0 = 9.9456e-04
Validation auc = 0.722999
Epoch 7815
Loss = 8.1176e-03, PNorm = 480.0643, GNorm = 0.5341, lr_0 = 9.9456e-04
Validation auc = 0.721050
Epoch 7816
Loss = 1.0156e-01, PNorm = 480.0899, GNorm = 7.3583, lr_0 = 9.9456e-04
Validation auc = 0.718880
Epoch 7817
Loss = 8.2541e-03, PNorm = 480.1275, GNorm = 0.3256, lr_0 = 9.9455e-04
Validation auc = 0.719944
Epoch 7818
Loss = 1.3462e-02, PNorm = 480.1550, GNorm = 0.5275, lr_0 = 9.9455e-04
Validation auc = 0.721977
Epoch 7819
Loss = 9.5023e-03, PNorm = 480.1731, GNorm = 0.5070, lr_0 = 9.9455e-04
Loss = 6.3367e-02, PNorm = 480.1917, GNorm = 1.7899, lr_0 = 9.9455e-04
Validation auc = 0.719448
Epoch 7820
Loss = 2.5559e-02, PNorm = 480.2197, GNorm = 0.1438, lr_0 = 9.9455e-04
Validation auc = 0.712598
Epoch 7821
Loss = 1.8474e-02, PNorm = 480.2501, GNorm = 0.4774, lr_0 = 9.9455e-04
Validation auc = 0.724605
Epoch 7822
Loss = 2.3932e-02, PNorm = 480.2771, GNorm = 0.8535, lr_0 = 9.9455e-04
Validation auc = 0.721489
Epoch 7823
Loss = 1.0433e-02, PNorm = 480.2995, GNorm = 0.8597, lr_0 = 9.9455e-04
Validation auc = 0.717981
Epoch 7824
Loss = 1.0168e-02, PNorm = 480.3140, GNorm = 1.0772, lr_0 = 9.9455e-04
Validation auc = 0.716330
Epoch 7825
Loss = 3.3039e-02, PNorm = 480.3277, GNorm = 1.0181, lr_0 = 9.9455e-04
Validation auc = 0.713886
Epoch 7826
Loss = 3.6108e-03, PNorm = 480.3431, GNorm = 0.0219, lr_0 = 9.9455e-04
Validation auc = 0.713635
Epoch 7827
Loss = 7.7760e-02, PNorm = 480.3577, GNorm = 3.7646, lr_0 = 9.9455e-04
Validation auc = 0.706342
Epoch 7828
Loss = 4.6607e-03, PNorm = 480.3838, GNorm = 0.1829, lr_0 = 9.9455e-04
Validation auc = 0.713857
Epoch 7829
Loss = 4.8085e-03, PNorm = 480.4107, GNorm = 0.2237, lr_0 = 9.9455e-04
Loss = 4.7618e-02, PNorm = 480.4400, GNorm = 1.2242, lr_0 = 9.9455e-04
Validation auc = 0.715798
Epoch 7830
Loss = 2.0750e-02, PNorm = 480.4700, GNorm = 0.3979, lr_0 = 9.9454e-04
Validation auc = 0.722540
Epoch 7831
Loss = 8.4990e-02, PNorm = 480.4959, GNorm = 8.2576, lr_0 = 9.9454e-04
Validation auc = 0.723691
Epoch 7832
Loss = 3.8038e-02, PNorm = 480.5368, GNorm = 1.7063, lr_0 = 9.9454e-04
Validation auc = 0.724893
Epoch 7833
Loss = 3.8147e-02, PNorm = 480.5751, GNorm = 1.8080, lr_0 = 9.9454e-04
Validation auc = 0.729335
Epoch 7834
Loss = 2.7042e-02, PNorm = 480.6180, GNorm = 0.3154, lr_0 = 9.9454e-04
Validation auc = 0.732466
Epoch 7835
Loss = 4.1627e-02, PNorm = 480.6542, GNorm = 0.4352, lr_0 = 9.9454e-04
Validation auc = 0.740753
Epoch 7836
Loss = 2.0888e-02, PNorm = 480.6888, GNorm = 0.8439, lr_0 = 9.9454e-04
Validation auc = 0.739616
Epoch 7837
Loss = 4.0016e-02, PNorm = 480.7198, GNorm = 2.6091, lr_0 = 9.9454e-04
Validation auc = 0.737574
Epoch 7838
Loss = 2.3353e-01, PNorm = 480.7549, GNorm = 6.0044, lr_0 = 9.9454e-04
Validation auc = 0.739044
Epoch 7839
Loss = 5.0968e-02, PNorm = 480.7985, GNorm = 1.5393, lr_0 = 9.9454e-04
Loss = 2.5875e-02, PNorm = 480.8370, GNorm = 0.8266, lr_0 = 9.9454e-04
Validation auc = 0.737417
Epoch 7840
Loss = 2.8378e-02, PNorm = 480.8617, GNorm = 0.6293, lr_0 = 9.9454e-04
Validation auc = 0.738332
Epoch 7841
Loss = 4.8635e-02, PNorm = 480.8830, GNorm = 1.5055, lr_0 = 9.9454e-04
Validation auc = 0.742271
Epoch 7842
Loss = 4.0286e-02, PNorm = 480.9073, GNorm = 4.4971, lr_0 = 9.9454e-04
Validation auc = 0.741332
Epoch 7843
Loss = 5.6588e-02, PNorm = 480.9441, GNorm = 1.2821, lr_0 = 9.9454e-04
Validation auc = 0.740153
Epoch 7844
Loss = 2.4706e-02, PNorm = 480.9776, GNorm = 1.8436, lr_0 = 9.9453e-04
Validation auc = 0.738857
Epoch 7845
Loss = 1.0588e-02, PNorm = 481.0034, GNorm = 0.3569, lr_0 = 9.9453e-04
Validation auc = 0.736760
Epoch 7846
Loss = 4.4910e-02, PNorm = 481.0349, GNorm = 0.3104, lr_0 = 9.9453e-04
Validation auc = 0.741840
Epoch 7847
Loss = 3.6165e-02, PNorm = 481.0667, GNorm = 0.3345, lr_0 = 9.9453e-04
Validation auc = 0.744698
Epoch 7848
Loss = 1.3262e-02, PNorm = 481.0952, GNorm = 0.5049, lr_0 = 9.9453e-04
Validation auc = 0.749133
Epoch 7849
Loss = 4.4917e-02, PNorm = 481.1283, GNorm = 1.2853, lr_0 = 9.9453e-04
Loss = 4.1503e-02, PNorm = 481.1596, GNorm = 0.6345, lr_0 = 9.9453e-04
Validation auc = 0.748360
Epoch 7850
Loss = 2.3951e-02, PNorm = 481.1973, GNorm = 1.7583, lr_0 = 9.9453e-04
Validation auc = 0.741917
Epoch 7851
Loss = 1.2198e-02, PNorm = 481.2253, GNorm = 0.1659, lr_0 = 9.9453e-04
Validation auc = 0.735176
Epoch 7852
Loss = 2.1316e-02, PNorm = 481.2495, GNorm = 0.2640, lr_0 = 9.9453e-04
Validation auc = 0.734332
Epoch 7853
Loss = 3.1529e-02, PNorm = 481.2731, GNorm = 0.3959, lr_0 = 9.9453e-04
Validation auc = 0.734986
Epoch 7854
Loss = 1.4086e-02, PNorm = 481.3112, GNorm = 0.5867, lr_0 = 9.9453e-04
Validation auc = 0.738257
Epoch 7855
Loss = 2.5300e-02, PNorm = 481.3404, GNorm = 0.0624, lr_0 = 9.9453e-04
Validation auc = 0.738715
Epoch 7856
Loss = 2.8302e-02, PNorm = 481.3622, GNorm = 0.1720, lr_0 = 9.9453e-04
Validation auc = 0.733669
Epoch 7857
Loss = 2.9424e-02, PNorm = 481.3871, GNorm = 0.8606, lr_0 = 9.9452e-04
Validation auc = 0.729468
Epoch 7858
Loss = 2.5944e-02, PNorm = 481.4072, GNorm = 0.4149, lr_0 = 9.9452e-04
Validation auc = 0.729029
Epoch 7859
Loss = 2.0828e-03, PNorm = 481.4346, GNorm = 0.1125, lr_0 = 9.9452e-04
Loss = 1.6388e-02, PNorm = 481.4709, GNorm = 0.3071, lr_0 = 9.9452e-04
Validation auc = 0.728267
Epoch 7860
Loss = 3.5544e-02, PNorm = 481.5019, GNorm = 1.3143, lr_0 = 9.9452e-04
Validation auc = 0.721748
Epoch 7861
Loss = 2.6976e-02, PNorm = 481.5361, GNorm = 0.7902, lr_0 = 9.9452e-04
Validation auc = 0.715474
Epoch 7862
Loss = 1.3610e-02, PNorm = 481.5653, GNorm = 0.1723, lr_0 = 9.9452e-04
Validation auc = 0.713311
Epoch 7863
Loss = 7.0768e-03, PNorm = 481.5866, GNorm = 0.0884, lr_0 = 9.9452e-04
Validation auc = 0.714470
Epoch 7864
Loss = 2.4625e-02, PNorm = 481.6024, GNorm = 1.4460, lr_0 = 9.9452e-04
Validation auc = 0.715225
Epoch 7865
Loss = 1.7007e-02, PNorm = 481.6236, GNorm = 1.2249, lr_0 = 9.9452e-04
Validation auc = 0.717972
Epoch 7866
Loss = 4.3544e-02, PNorm = 481.6423, GNorm = 0.1788, lr_0 = 9.9452e-04
Validation auc = 0.723462
Epoch 7867
Loss = 1.2501e-02, PNorm = 481.6596, GNorm = 1.0309, lr_0 = 9.9452e-04
Validation auc = 0.727177
Epoch 7868
Loss = 4.0745e-03, PNorm = 481.6771, GNorm = 0.1793, lr_0 = 9.9452e-04
Validation auc = 0.727531
Epoch 7869
Loss = 1.3681e-01, PNorm = 481.6957, GNorm = 2.1107, lr_0 = 9.9452e-04
Loss = 3.6177e-03, PNorm = 481.7206, GNorm = 0.0971, lr_0 = 9.9452e-04
Validation auc = 0.724439
Epoch 7870
Loss = 3.0222e-02, PNorm = 481.7357, GNorm = 0.3611, lr_0 = 9.9451e-04
Validation auc = 0.722917
Epoch 7871
Loss = 3.3851e-02, PNorm = 481.7502, GNorm = 0.0464, lr_0 = 9.9451e-04
Validation auc = 0.719100
Epoch 7872
Loss = 1.2785e-02, PNorm = 481.7660, GNorm = 0.1454, lr_0 = 9.9451e-04
Validation auc = 0.719990
Epoch 7873
Loss = 1.4213e-02, PNorm = 481.7793, GNorm = 0.1721, lr_0 = 9.9451e-04
Validation auc = 0.719487
Epoch 7874
Loss = 1.9523e-02, PNorm = 481.7934, GNorm = 0.0196, lr_0 = 9.9451e-04
Validation auc = 0.721052
Epoch 7875
Loss = 1.4698e-02, PNorm = 481.8177, GNorm = 0.1750, lr_0 = 9.9451e-04
Validation auc = 0.719486
Epoch 7876
Loss = 2.8985e-02, PNorm = 481.8476, GNorm = 0.3664, lr_0 = 9.9451e-04
Validation auc = 0.715493
Epoch 7877
Loss = 1.6798e-02, PNorm = 481.8750, GNorm = 0.7626, lr_0 = 9.9451e-04
Validation auc = 0.716739
Epoch 7878
Loss = 8.3653e-04, PNorm = 481.8969, GNorm = 0.0471, lr_0 = 9.9451e-04
Validation auc = 0.722259
Epoch 7879
Loss = 2.9327e-01, PNorm = 481.9166, GNorm = 3.5889, lr_0 = 9.9451e-04
Loss = 2.7406e-02, PNorm = 481.9358, GNorm = 0.8573, lr_0 = 9.9451e-04
Validation auc = 0.728800
Epoch 7880
Loss = 2.4434e-02, PNorm = 481.9575, GNorm = 1.7281, lr_0 = 9.9451e-04
Validation auc = 0.733121
Epoch 7881
Loss = 2.7071e-02, PNorm = 481.9841, GNorm = 0.1008, lr_0 = 9.9451e-04
Validation auc = 0.733272
Epoch 7882
Loss = 1.9012e-02, PNorm = 482.0079, GNorm = 0.0547, lr_0 = 9.9451e-04
Validation auc = 0.723495
Epoch 7883
Loss = 9.5979e-03, PNorm = 482.0257, GNorm = 0.2904, lr_0 = 9.9450e-04
Validation auc = 0.720083
Epoch 7884
Loss = 5.7890e-02, PNorm = 482.0453, GNorm = 2.5731, lr_0 = 9.9450e-04
Validation auc = 0.718249
Epoch 7885
Loss = 3.2196e-02, PNorm = 482.0781, GNorm = 0.2997, lr_0 = 9.9450e-04
Validation auc = 0.722219
Epoch 7886
Loss = 2.6812e-02, PNorm = 482.1120, GNorm = 0.0771, lr_0 = 9.9450e-04
Validation auc = 0.723023
Epoch 7887
Loss = 2.4549e-03, PNorm = 482.1385, GNorm = 0.0453, lr_0 = 9.9450e-04
Validation auc = 0.722260
Epoch 7888
Loss = 3.3469e-03, PNorm = 482.1555, GNorm = 0.1401, lr_0 = 9.9450e-04
Validation auc = 0.725495
Epoch 7889
Loss = 7.1975e-02, PNorm = 482.1734, GNorm = 2.8319, lr_0 = 9.9450e-04
Loss = 1.1138e-02, PNorm = 482.2001, GNorm = 0.0262, lr_0 = 9.9450e-04
Validation auc = 0.730849
Epoch 7890
Loss = 2.2899e-02, PNorm = 482.2190, GNorm = 2.2263, lr_0 = 9.9450e-04
Validation auc = 0.733367
Epoch 7891
Loss = 4.3998e-02, PNorm = 482.2416, GNorm = 1.6445, lr_0 = 9.9450e-04
Validation auc = 0.736052
Epoch 7892
Loss = 2.6476e-02, PNorm = 482.2709, GNorm = 0.2199, lr_0 = 9.9450e-04
Validation auc = 0.737759
Epoch 7893
Loss = 1.5813e-02, PNorm = 482.2972, GNorm = 0.0719, lr_0 = 9.9450e-04
Validation auc = 0.738252
Epoch 7894
Loss = 3.2570e-02, PNorm = 482.3175, GNorm = 1.6210, lr_0 = 9.9450e-04
Validation auc = 0.737623
Epoch 7895
Loss = 9.8322e-03, PNorm = 482.3405, GNorm = 0.1328, lr_0 = 9.9450e-04
Validation auc = 0.731536
Epoch 7896
Loss = 3.3876e-03, PNorm = 482.3663, GNorm = 0.1728, lr_0 = 9.9450e-04
Validation auc = 0.731332
Epoch 7897
Loss = 1.6048e-02, PNorm = 482.3867, GNorm = 1.6440, lr_0 = 9.9449e-04
Validation auc = 0.730629
Epoch 7898
Loss = 2.3029e-03, PNorm = 482.4088, GNorm = 0.0604, lr_0 = 9.9449e-04
Validation auc = 0.730802
Epoch 7899
Loss = 1.0019e-02, PNorm = 482.4371, GNorm = 0.6731, lr_0 = 9.9449e-04
Loss = 7.2980e-03, PNorm = 482.4581, GNorm = 0.1904, lr_0 = 9.9449e-04
Validation auc = 0.729867
Epoch 7900
Loss = 2.1614e-02, PNorm = 482.4719, GNorm = 2.4524, lr_0 = 9.9449e-04
Validation auc = 0.730046
Epoch 7901
Loss = 3.5901e-02, PNorm = 482.4889, GNorm = 2.8434, lr_0 = 9.9449e-04
Validation auc = 0.737375
Epoch 7902
Loss = 1.9152e-02, PNorm = 482.5144, GNorm = 0.5429, lr_0 = 9.9449e-04
Validation auc = 0.738479
Epoch 7903
Loss = 2.9665e-02, PNorm = 482.5360, GNorm = 0.1821, lr_0 = 9.9449e-04
Validation auc = 0.744060
Epoch 7904
Loss = 1.7621e-02, PNorm = 482.5623, GNorm = 0.2667, lr_0 = 9.9449e-04
Validation auc = 0.747291
Epoch 7905
Loss = 4.5016e-02, PNorm = 482.5820, GNorm = 0.0640, lr_0 = 9.9449e-04
Validation auc = 0.748242
Epoch 7906
Loss = 3.4480e-02, PNorm = 482.6052, GNorm = 0.5455, lr_0 = 9.9449e-04
Validation auc = 0.738316
Epoch 7907
Loss = 3.5485e-02, PNorm = 482.6337, GNorm = 1.1969, lr_0 = 9.9449e-04
Validation auc = 0.733616
Epoch 7908
Loss = 1.5185e-02, PNorm = 482.6612, GNorm = 0.1940, lr_0 = 9.9449e-04
Validation auc = 0.730800
Epoch 7909
Loss = 2.4754e-03, PNorm = 482.6861, GNorm = 0.1502, lr_0 = 9.9449e-04
Loss = 2.8137e-02, PNorm = 482.7119, GNorm = 0.1993, lr_0 = 9.9449e-04
Validation auc = 0.730714
Epoch 7910
Loss = 5.3125e-02, PNorm = 482.7427, GNorm = 0.7391, lr_0 = 9.9448e-04
Validation auc = 0.731051
Epoch 7911
Loss = 2.8586e-02, PNorm = 482.7787, GNorm = 0.4226, lr_0 = 9.9448e-04
Validation auc = 0.717559
Epoch 7912
Loss = 1.9506e-02, PNorm = 482.8091, GNorm = 0.7235, lr_0 = 9.9448e-04
Validation auc = 0.708745
Epoch 7913
Loss = 1.3452e-02, PNorm = 482.8300, GNorm = 0.0980, lr_0 = 9.9448e-04
Validation auc = 0.706167
Epoch 7914
Loss = 3.1281e-02, PNorm = 482.8549, GNorm = 0.0641, lr_0 = 9.9448e-04
Validation auc = 0.706217
Epoch 7915
Loss = 1.4375e-02, PNorm = 482.8804, GNorm = 0.1129, lr_0 = 9.9448e-04
Validation auc = 0.703877
Epoch 7916
Loss = 8.0491e-03, PNorm = 482.8982, GNorm = 2.3211, lr_0 = 9.9448e-04
Validation auc = 0.704470
Epoch 7917
Loss = 2.7906e-02, PNorm = 482.9180, GNorm = 0.1419, lr_0 = 9.9448e-04
Validation auc = 0.703086
Epoch 7918
Loss = 2.4273e-02, PNorm = 482.9423, GNorm = 0.6781, lr_0 = 9.9448e-04
Validation auc = 0.710692
Epoch 7919
Loss = 3.3095e-03, PNorm = 482.9743, GNorm = 0.0942, lr_0 = 9.9448e-04
Loss = 2.5863e-03, PNorm = 482.9957, GNorm = 0.0828, lr_0 = 9.9448e-04
Validation auc = 0.713333
Epoch 7920
Loss = 7.0705e-03, PNorm = 483.0073, GNorm = 0.1402, lr_0 = 9.9448e-04
Validation auc = 0.712789
Epoch 7921
Loss = 1.7742e-02, PNorm = 483.0179, GNorm = 0.3361, lr_0 = 9.9448e-04
Validation auc = 0.714566
Epoch 7922
Loss = 2.2351e-02, PNorm = 483.0356, GNorm = 0.5891, lr_0 = 9.9448e-04
Validation auc = 0.715834
Epoch 7923
Loss = 3.4850e-02, PNorm = 483.0623, GNorm = 0.2172, lr_0 = 9.9447e-04
Validation auc = 0.714710
Epoch 7924
Loss = 9.6047e-03, PNorm = 483.0970, GNorm = 0.5893, lr_0 = 9.9447e-04
Validation auc = 0.706719
Epoch 7925
Loss = 5.1255e-03, PNorm = 483.1268, GNorm = 0.1664, lr_0 = 9.9447e-04
Validation auc = 0.702372
Epoch 7926
Loss = 6.5516e-03, PNorm = 483.1529, GNorm = 0.3344, lr_0 = 9.9447e-04
Validation auc = 0.696659
Epoch 7927
Loss = 3.9102e-02, PNorm = 483.1816, GNorm = 1.2439, lr_0 = 9.9447e-04
Validation auc = 0.692966
Epoch 7928
Loss = 5.1563e-02, PNorm = 483.2171, GNorm = 0.6551, lr_0 = 9.9447e-04
Validation auc = 0.690076
Epoch 7929
Loss = 3.1291e-03, PNorm = 483.2479, GNorm = 0.1135, lr_0 = 9.9447e-04
Loss = 3.3743e-02, PNorm = 483.2721, GNorm = 0.5726, lr_0 = 9.9447e-04
Validation auc = 0.689405
Epoch 7930
Loss = 3.8408e-02, PNorm = 483.3038, GNorm = 5.0802, lr_0 = 9.9447e-04
Validation auc = 0.692924
Epoch 7931
Loss = 2.2098e-02, PNorm = 483.3444, GNorm = 0.0329, lr_0 = 9.9447e-04
Validation auc = 0.692552
Epoch 7932
Loss = 3.2307e-02, PNorm = 483.3783, GNorm = 2.3705, lr_0 = 9.9447e-04
Validation auc = 0.692918
Epoch 7933
Loss = 5.8094e-02, PNorm = 483.4132, GNorm = 1.5813, lr_0 = 9.9447e-04
Validation auc = 0.689495
Epoch 7934
Loss = 5.5474e-02, PNorm = 483.4481, GNorm = 1.5533, lr_0 = 9.9447e-04
Validation auc = 0.689794
Epoch 7935
Loss = 5.2110e-02, PNorm = 483.4756, GNorm = 0.1962, lr_0 = 9.9447e-04
Validation auc = 0.690655
Epoch 7936
Loss = 7.1286e-03, PNorm = 483.4995, GNorm = 0.1228, lr_0 = 9.9447e-04
Validation auc = 0.690436
Epoch 7937
Loss = 4.3983e-03, PNorm = 483.5155, GNorm = 0.0439, lr_0 = 9.9446e-04
Validation auc = 0.688542
Epoch 7938
Loss = 2.5225e-02, PNorm = 483.5330, GNorm = 2.1877, lr_0 = 9.9446e-04
Validation auc = 0.692873
Epoch 7939
Loss = 6.7797e-02, PNorm = 483.5536, GNorm = 1.1049, lr_0 = 9.9446e-04
Loss = 1.3987e-02, PNorm = 483.5726, GNorm = 1.0528, lr_0 = 9.9446e-04
Validation auc = 0.694849
Epoch 7940
Loss = 2.1389e-02, PNorm = 483.5906, GNorm = 3.9663, lr_0 = 9.9446e-04
Validation auc = 0.696757
Epoch 7941
Loss = 2.6173e-02, PNorm = 483.6140, GNorm = 0.0377, lr_0 = 9.9446e-04
Validation auc = 0.699449
Epoch 7942
Loss = 2.8296e-02, PNorm = 483.6407, GNorm = 0.0707, lr_0 = 9.9446e-04
Validation auc = 0.699066
Epoch 7943
Loss = 3.5410e-02, PNorm = 483.6658, GNorm = 1.3339, lr_0 = 9.9446e-04
Validation auc = 0.703718
Epoch 7944
Loss = 3.3681e-03, PNorm = 483.6894, GNorm = 0.2935, lr_0 = 9.9446e-04
Validation auc = 0.703094
Epoch 7945
Loss = 3.7665e-02, PNorm = 483.7025, GNorm = 0.2366, lr_0 = 9.9446e-04
Validation auc = 0.698025
Epoch 7946
Loss = 5.5348e-03, PNorm = 483.7154, GNorm = 0.1739, lr_0 = 9.9446e-04
Validation auc = 0.701168
Epoch 7947
Loss = 4.0394e-02, PNorm = 483.7332, GNorm = 0.1426, lr_0 = 9.9446e-04
Validation auc = 0.704669
Epoch 7948
Loss = 4.2064e-03, PNorm = 483.7594, GNorm = 0.2496, lr_0 = 9.9446e-04
Validation auc = 0.705968
Epoch 7949
Loss = 5.2624e-03, PNorm = 483.7833, GNorm = 0.3099, lr_0 = 9.9446e-04
Loss = 1.7236e-02, PNorm = 483.8081, GNorm = 0.1685, lr_0 = 9.9446e-04
Validation auc = 0.702947
Epoch 7950
Loss = 2.7575e-02, PNorm = 483.8358, GNorm = 1.4291, lr_0 = 9.9445e-04
Validation auc = 0.698432
Epoch 7951
Loss = 2.2820e-02, PNorm = 483.8616, GNorm = 0.0691, lr_0 = 9.9445e-04
Validation auc = 0.694702
Epoch 7952
Loss = 1.5393e-02, PNorm = 483.8918, GNorm = 0.0634, lr_0 = 9.9445e-04
Validation auc = 0.695102
Epoch 7953
Loss = 1.4281e-02, PNorm = 483.9222, GNorm = 0.2407, lr_0 = 9.9445e-04
Validation auc = 0.692281
Epoch 7954
Loss = 5.4587e-03, PNorm = 483.9476, GNorm = 0.5984, lr_0 = 9.9445e-04
Validation auc = 0.691202
Epoch 7955
Loss = 2.3069e-02, PNorm = 483.9668, GNorm = 0.0144, lr_0 = 9.9445e-04
Validation auc = 0.694823
Epoch 7956
Loss = 6.7151e-03, PNorm = 483.9890, GNorm = 0.1657, lr_0 = 9.9445e-04
Validation auc = 0.697235
Epoch 7957
Loss = 1.1578e-02, PNorm = 484.0087, GNorm = 1.7549, lr_0 = 9.9445e-04
Validation auc = 0.692624
Epoch 7958
Loss = 3.3160e-02, PNorm = 484.0277, GNorm = 1.6926, lr_0 = 9.9445e-04
Validation auc = 0.690975
Epoch 7959
Loss = 4.6274e-03, PNorm = 484.0571, GNorm = 0.8162, lr_0 = 9.9445e-04
Loss = 1.9051e-02, PNorm = 484.0837, GNorm = 2.6726, lr_0 = 9.9445e-04
Validation auc = 0.698574
Epoch 7960
Loss = 5.0877e-02, PNorm = 484.1125, GNorm = 3.4269, lr_0 = 9.9445e-04
Validation auc = 0.714973
Epoch 7961
Loss = 1.9682e-02, PNorm = 484.1764, GNorm = 11.0884, lr_0 = 9.9445e-04
Validation auc = 0.725668
Epoch 7962
Loss = 5.1925e-02, PNorm = 484.2535, GNorm = 1.2108, lr_0 = 9.9445e-04
Validation auc = 0.722573
Epoch 7963
Loss = 5.8138e-02, PNorm = 484.3143, GNorm = 1.3910, lr_0 = 9.9444e-04
Validation auc = 0.716630
Epoch 7964
Loss = 2.6542e-02, PNorm = 484.3630, GNorm = 2.6298, lr_0 = 9.9444e-04
Validation auc = 0.715353
Epoch 7965
Loss = 2.4704e-02, PNorm = 484.4094, GNorm = 0.7852, lr_0 = 9.9444e-04
Validation auc = 0.721819
Epoch 7966
Loss = 1.7304e-02, PNorm = 484.4543, GNorm = 0.8855, lr_0 = 9.9444e-04
Validation auc = 0.718867
Epoch 7967
Loss = 6.6279e-03, PNorm = 484.5000, GNorm = 0.1018, lr_0 = 9.9444e-04
Validation auc = 0.719939
Epoch 7968
Loss = 5.6242e-02, PNorm = 484.5461, GNorm = 4.3286, lr_0 = 9.9444e-04
Validation auc = 0.723557
Epoch 7969
Loss = 9.5031e-04, PNorm = 484.5943, GNorm = 0.0370, lr_0 = 9.9444e-04
Loss = 5.7222e-02, PNorm = 484.6315, GNorm = 2.1875, lr_0 = 9.9444e-04
Validation auc = 0.721689
Epoch 7970
Loss = 1.9745e-02, PNorm = 484.6717, GNorm = 1.0289, lr_0 = 9.9444e-04
Validation auc = 0.716814
Epoch 7971
Loss = 2.3267e-02, PNorm = 484.7061, GNorm = 0.5675, lr_0 = 9.9444e-04
Validation auc = 0.715187
Epoch 7972
Loss = 1.5232e-02, PNorm = 484.7335, GNorm = 0.1040, lr_0 = 9.9444e-04
Validation auc = 0.713457
Epoch 7973
Loss = 3.8805e-02, PNorm = 484.7638, GNorm = 0.0359, lr_0 = 9.9444e-04
Validation auc = 0.713102
Epoch 7974
Loss = 7.2425e-02, PNorm = 484.8073, GNorm = 3.7193, lr_0 = 9.9444e-04
Validation auc = 0.708966
Epoch 7975
Loss = 4.4652e-02, PNorm = 484.8485, GNorm = 0.5670, lr_0 = 9.9444e-04
Validation auc = 0.710357
Epoch 7976
Loss = 3.1274e-02, PNorm = 484.8842, GNorm = 0.6404, lr_0 = 9.9444e-04
Validation auc = 0.711154
Epoch 7977
Loss = 3.6230e-02, PNorm = 484.9187, GNorm = 0.5507, lr_0 = 9.9443e-04
Validation auc = 0.711389
Epoch 7978
Loss = 8.6803e-03, PNorm = 484.9470, GNorm = 0.2866, lr_0 = 9.9443e-04
Validation auc = 0.715901
Epoch 7979
Loss = 1.7100e-02, PNorm = 484.9727, GNorm = 0.5675, lr_0 = 9.9443e-04
Loss = 5.8726e-02, PNorm = 485.0107, GNorm = 0.3553, lr_0 = 9.9443e-04
Validation auc = 0.721582
Epoch 7980
Loss = 7.2847e-02, PNorm = 485.0520, GNorm = 2.3337, lr_0 = 9.9443e-04
Validation auc = 0.723983
Epoch 7981
Loss = 3.6868e-02, PNorm = 485.0976, GNorm = 0.2519, lr_0 = 9.9443e-04
Validation auc = 0.725163
Epoch 7982
Loss = 4.0604e-02, PNorm = 485.1386, GNorm = 4.4431, lr_0 = 9.9443e-04
Validation auc = 0.725623
Epoch 7983
Loss = 3.6882e-02, PNorm = 485.1738, GNorm = 0.1378, lr_0 = 9.9443e-04
Validation auc = 0.723790
Epoch 7984
Loss = 1.8465e-02, PNorm = 485.2030, GNorm = 0.1418, lr_0 = 9.9443e-04
Validation auc = 0.720902
Epoch 7985
Loss = 1.7989e-02, PNorm = 485.2218, GNorm = 0.9387, lr_0 = 9.9443e-04
Validation auc = 0.715450
Epoch 7986
Loss = 8.3261e-02, PNorm = 485.2377, GNorm = 3.3351, lr_0 = 9.9443e-04
Validation auc = 0.715260
Epoch 7987
Loss = 8.0472e-02, PNorm = 485.2640, GNorm = 4.2058, lr_0 = 9.9443e-04
Validation auc = 0.716771
Epoch 7988
Loss = 4.1679e-03, PNorm = 485.3027, GNorm = 0.0635, lr_0 = 9.9443e-04
Validation auc = 0.714206
Epoch 7989
Loss = 3.2961e-03, PNorm = 485.3395, GNorm = 0.1142, lr_0 = 9.9443e-04
Loss = 3.2414e-02, PNorm = 485.3730, GNorm = 1.3050, lr_0 = 9.9442e-04
Validation auc = 0.714433
Epoch 7990
Loss = 3.2384e-02, PNorm = 485.4046, GNorm = 1.6365, lr_0 = 9.9442e-04
Validation auc = 0.715392
Epoch 7991
Loss = 1.6940e-02, PNorm = 485.4342, GNorm = 0.0925, lr_0 = 9.9442e-04
Validation auc = 0.713039
Epoch 7992
Loss = 1.7811e-02, PNorm = 485.4582, GNorm = 1.1294, lr_0 = 9.9442e-04
Validation auc = 0.712030
Epoch 7993
Loss = 4.9624e-02, PNorm = 485.4846, GNorm = 1.2772, lr_0 = 9.9442e-04
Validation auc = 0.705245
Epoch 7994
Loss = 3.2977e-02, PNorm = 485.5153, GNorm = 0.5573, lr_0 = 9.9442e-04
Validation auc = 0.706520
Epoch 7995
Loss = 4.2903e-02, PNorm = 485.5466, GNorm = 1.7530, lr_0 = 9.9442e-04
Validation auc = 0.709956
Epoch 7996
Loss = 1.0312e-02, PNorm = 485.5821, GNorm = 1.5263, lr_0 = 9.9442e-04
Validation auc = 0.705698
Epoch 7997
Loss = 1.0782e-02, PNorm = 485.6089, GNorm = 1.5263, lr_0 = 9.9442e-04
Validation auc = 0.704817
Epoch 7998
Loss = 2.7996e-02, PNorm = 485.6407, GNorm = 0.2723, lr_0 = 9.9442e-04
Validation auc = 0.704998
Epoch 7999
Loss = 1.9976e-03, PNorm = 485.6720, GNorm = 0.2130, lr_0 = 9.9442e-04
Loss = 3.0799e-02, PNorm = 485.6985, GNorm = 0.1060, lr_0 = 9.9442e-04
Validation auc = 0.707365
Epoch 8000
Loss = 2.9670e-02, PNorm = 485.7347, GNorm = 0.3659, lr_0 = 9.9442e-04
Validation auc = 0.708800
Epoch 8001
Loss = 3.3839e-02, PNorm = 485.7649, GNorm = 2.0952, lr_0 = 9.9442e-04
Validation auc = 0.709235
Epoch 8002
Loss = 4.3888e-02, PNorm = 485.7930, GNorm = 2.2830, lr_0 = 9.9442e-04
Validation auc = 0.709201
Epoch 8003
Loss = 1.4814e-02, PNorm = 485.8201, GNorm = 0.8328, lr_0 = 9.9441e-04
Validation auc = 0.706144
Epoch 8004
Loss = 2.9192e-02, PNorm = 485.8448, GNorm = 0.1455, lr_0 = 9.9441e-04
Validation auc = 0.702484
Epoch 8005
Loss = 1.1884e-02, PNorm = 485.8683, GNorm = 0.7323, lr_0 = 9.9441e-04
Validation auc = 0.705029
Epoch 8006
Loss = 3.9131e-03, PNorm = 485.8857, GNorm = 0.0749, lr_0 = 9.9441e-04
Validation auc = 0.706052
Epoch 8007
Loss = 2.5419e-02, PNorm = 485.9046, GNorm = 2.8480, lr_0 = 9.9441e-04
Validation auc = 0.705604
Epoch 8008
Loss = 1.1269e-02, PNorm = 485.9261, GNorm = 0.6935, lr_0 = 9.9441e-04
Validation auc = 0.707240
Epoch 8009
Loss = 1.1578e-02, PNorm = 485.9487, GNorm = 0.6903, lr_0 = 9.9441e-04
Loss = 2.0203e-02, PNorm = 485.9761, GNorm = 0.3650, lr_0 = 9.9441e-04
Validation auc = 0.706760
Epoch 8010
Loss = 1.6954e-02, PNorm = 485.9979, GNorm = 0.1281, lr_0 = 9.9441e-04
Validation auc = 0.708070
Epoch 8011
Loss = 1.1880e-02, PNorm = 486.0155, GNorm = 0.3009, lr_0 = 9.9441e-04
Validation auc = 0.709926
Epoch 8012
Loss = 2.0828e-02, PNorm = 486.0319, GNorm = 0.9535, lr_0 = 9.9441e-04
Validation auc = 0.709065
Epoch 8013
Loss = 7.6107e-03, PNorm = 486.0470, GNorm = 0.3011, lr_0 = 9.9441e-04
Validation auc = 0.707704
Epoch 8014
Loss = 1.7507e-02, PNorm = 486.0599, GNorm = 0.0909, lr_0 = 9.9441e-04
Validation auc = 0.702464
Epoch 8015
Loss = 5.3860e-03, PNorm = 486.0758, GNorm = 0.1417, lr_0 = 9.9441e-04
Validation auc = 0.704406
Epoch 8016
Loss = 3.6450e-02, PNorm = 486.0903, GNorm = 0.0420, lr_0 = 9.9441e-04
Validation auc = 0.708190
Epoch 8017
Loss = 6.1354e-03, PNorm = 486.1139, GNorm = 0.1783, lr_0 = 9.9440e-04
Validation auc = 0.708770
Epoch 8018
Loss = 3.0652e-03, PNorm = 486.1471, GNorm = 0.1408, lr_0 = 9.9440e-04
Validation auc = 0.707743
Epoch 8019
Loss = 1.2756e-02, PNorm = 486.1863, GNorm = 0.6260, lr_0 = 9.9440e-04
Loss = 4.1641e-02, PNorm = 486.2320, GNorm = 2.1546, lr_0 = 9.9440e-04
Validation auc = 0.706531
Epoch 8020
Loss = 8.7805e-03, PNorm = 486.2721, GNorm = 0.2581, lr_0 = 9.9440e-04
Validation auc = 0.703739
Epoch 8021
Loss = 1.7873e-02, PNorm = 486.2959, GNorm = 0.1185, lr_0 = 9.9440e-04
Validation auc = 0.704301
Epoch 8022
Loss = 2.1642e-02, PNorm = 486.3204, GNorm = 0.1806, lr_0 = 9.9440e-04
Validation auc = 0.701240
Epoch 8023
Loss = 3.1824e-02, PNorm = 486.3415, GNorm = 2.4276, lr_0 = 9.9440e-04
Validation auc = 0.699042
Epoch 8024
Loss = 2.4699e-02, PNorm = 486.3613, GNorm = 0.2591, lr_0 = 9.9440e-04
Validation auc = 0.696768
Epoch 8025
Loss = 6.7395e-03, PNorm = 486.3817, GNorm = 1.0845, lr_0 = 9.9440e-04
Validation auc = 0.702123
Epoch 8026
Loss = 4.5987e-02, PNorm = 486.3979, GNorm = 0.8935, lr_0 = 9.9440e-04
Validation auc = 0.700575
Epoch 8027
Loss = 6.9056e-03, PNorm = 486.4247, GNorm = 0.0481, lr_0 = 9.9440e-04
Validation auc = 0.701825
Epoch 8028
Loss = 2.3457e-02, PNorm = 486.4620, GNorm = 1.4758, lr_0 = 9.9440e-04
Validation auc = 0.709092
Epoch 8029
Loss = 1.7288e-03, PNorm = 486.4966, GNorm = 0.1218, lr_0 = 9.9440e-04
Loss = 3.8434e-03, PNorm = 486.5264, GNorm = 0.2087, lr_0 = 9.9439e-04
Validation auc = 0.711332
Epoch 8030
Loss = 7.3919e-02, PNorm = 486.5504, GNorm = 0.4573, lr_0 = 9.9439e-04
Validation auc = 0.724033
Epoch 8031
Loss = 6.6203e-02, PNorm = 486.5806, GNorm = 0.2719, lr_0 = 9.9439e-04
Validation auc = 0.726166
Epoch 8032
Loss = 3.5213e-02, PNorm = 486.6111, GNorm = 0.2881, lr_0 = 9.9439e-04
Validation auc = 0.723819
Epoch 8033
Loss = 2.2872e-02, PNorm = 486.6367, GNorm = 0.7722, lr_0 = 9.9439e-04
Validation auc = 0.720836
Epoch 8034
Loss = 4.6416e-02, PNorm = 486.6627, GNorm = 0.0850, lr_0 = 9.9439e-04
Validation auc = 0.722177
Epoch 8035
Loss = 2.1878e-02, PNorm = 486.6852, GNorm = 0.1159, lr_0 = 9.9439e-04
Validation auc = 0.721239
Epoch 8036
Loss = 9.7172e-02, PNorm = 486.7116, GNorm = 3.8274, lr_0 = 9.9439e-04
Validation auc = 0.716930
Epoch 8037
Loss = 4.0687e-02, PNorm = 486.7422, GNorm = 0.0577, lr_0 = 9.9439e-04
Validation auc = 0.713822
Epoch 8038
Loss = 1.3486e-02, PNorm = 486.7652, GNorm = 0.9700, lr_0 = 9.9439e-04
Validation auc = 0.714267
Epoch 8039
Loss = 8.6663e-02, PNorm = 486.7798, GNorm = 1.1518, lr_0 = 9.9439e-04
Loss = 6.3366e-03, PNorm = 486.7930, GNorm = 0.3116, lr_0 = 9.9439e-04
Validation auc = 0.713272
Epoch 8040
Loss = 2.4746e-02, PNorm = 486.8090, GNorm = 1.3244, lr_0 = 9.9439e-04
Validation auc = 0.714181
Epoch 8041
Loss = 1.3437e-02, PNorm = 486.8267, GNorm = 0.3572, lr_0 = 9.9439e-04
Validation auc = 0.716728
Epoch 8042
Loss = 1.8671e-02, PNorm = 486.8442, GNorm = 0.2175, lr_0 = 9.9439e-04
Validation auc = 0.717714
Epoch 8043
Loss = 4.2257e-02, PNorm = 486.8738, GNorm = 0.3436, lr_0 = 9.9438e-04
Validation auc = 0.712888
Epoch 8044
Loss = 1.7922e-02, PNorm = 486.9098, GNorm = 2.6250, lr_0 = 9.9438e-04
Validation auc = 0.710603
Epoch 8045
Loss = 4.2672e-03, PNorm = 486.9349, GNorm = 0.8292, lr_0 = 9.9438e-04
Validation auc = 0.713343
Epoch 8046
Loss = 3.3651e-02, PNorm = 486.9628, GNorm = 0.0339, lr_0 = 9.9438e-04
Validation auc = 0.704738
Epoch 8047
Loss = 1.4808e-02, PNorm = 487.0066, GNorm = 0.1634, lr_0 = 9.9438e-04
Validation auc = 0.707102
Epoch 8048
Loss = 8.3548e-04, PNorm = 487.0486, GNorm = 0.0691, lr_0 = 9.9438e-04
Validation auc = 0.703404
Epoch 8049
Loss = 7.3902e-02, PNorm = 487.0861, GNorm = 0.9625, lr_0 = 9.9438e-04
Loss = 3.4963e-02, PNorm = 487.1169, GNorm = 0.2595, lr_0 = 9.9438e-04
Validation auc = 0.706448
Epoch 8050
Loss = 5.5022e-02, PNorm = 487.1448, GNorm = 1.0243, lr_0 = 9.9438e-04
Validation auc = 0.714121
Epoch 8051
Loss = 4.0101e-02, PNorm = 487.1856, GNorm = 1.7948, lr_0 = 9.9438e-04
Validation auc = 0.716943
Epoch 8052
Loss = 2.7340e-02, PNorm = 487.2179, GNorm = 1.2180, lr_0 = 9.9438e-04
Validation auc = 0.718280
Epoch 8053
Loss = 4.8363e-02, PNorm = 487.2433, GNorm = 0.4329, lr_0 = 9.9438e-04
Validation auc = 0.727354
Epoch 8054
Loss = 1.4077e-02, PNorm = 487.2680, GNorm = 1.8062, lr_0 = 9.9438e-04
Validation auc = 0.732079
Epoch 8055
Loss = 1.4349e-02, PNorm = 487.2929, GNorm = 2.0253, lr_0 = 9.9438e-04
Validation auc = 0.737088
Epoch 8056
Loss = 1.7461e-02, PNorm = 487.3166, GNorm = 1.3540, lr_0 = 9.9437e-04
Validation auc = 0.737860
Epoch 8057
Loss = 2.2214e-02, PNorm = 487.3435, GNorm = 0.0515, lr_0 = 9.9437e-04
Validation auc = 0.734801
Epoch 8058
Loss = 7.0494e-03, PNorm = 487.3674, GNorm = 0.6222, lr_0 = 9.9437e-04
Validation auc = 0.730275
Epoch 8059
Loss = 1.5150e-01, PNorm = 487.3894, GNorm = 5.1716, lr_0 = 9.9437e-04
Loss = 1.0913e-01, PNorm = 487.4446, GNorm = 0.1661, lr_0 = 9.9437e-04
Validation auc = 0.717086
Epoch 8060
Loss = 7.7804e-02, PNorm = 487.5069, GNorm = 0.6676, lr_0 = 9.9437e-04
Validation auc = 0.704346
Epoch 8061
Loss = 6.6712e-02, PNorm = 487.5667, GNorm = 0.4320, lr_0 = 9.9437e-04
Validation auc = 0.696789
Epoch 8062
Loss = 3.9050e-02, PNorm = 487.6153, GNorm = 0.3798, lr_0 = 9.9437e-04
Validation auc = 0.701056
Epoch 8063
Loss = 4.8829e-02, PNorm = 487.6466, GNorm = 3.5931, lr_0 = 9.9437e-04
Validation auc = 0.701106
Epoch 8064
Loss = 3.9496e-02, PNorm = 487.6757, GNorm = 0.8027, lr_0 = 9.9437e-04
Validation auc = 0.698782
Epoch 8065
Loss = 2.7999e-02, PNorm = 487.7066, GNorm = 1.2007, lr_0 = 9.9437e-04
Validation auc = 0.704003
Epoch 8066
Loss = 9.4479e-03, PNorm = 487.7313, GNorm = 0.7711, lr_0 = 9.9437e-04
Validation auc = 0.707697
Epoch 8067
Loss = 1.9416e-02, PNorm = 487.7561, GNorm = 0.9630, lr_0 = 9.9437e-04
Validation auc = 0.706531
Epoch 8068
Loss = 6.1781e-03, PNorm = 487.7919, GNorm = 0.3488, lr_0 = 9.9437e-04
Validation auc = 0.708223
Epoch 8069
Loss = 8.8130e-02, PNorm = 487.8276, GNorm = 1.6431, lr_0 = 9.9437e-04
Loss = 1.9699e-02, PNorm = 487.8616, GNorm = 0.1381, lr_0 = 9.9436e-04
Validation auc = 0.714527
Epoch 8070
Loss = 2.2811e-02, PNorm = 487.8973, GNorm = 0.0537, lr_0 = 9.9436e-04
Validation auc = 0.713826
Epoch 8071
Loss = 1.0084e-01, PNorm = 487.9353, GNorm = 0.5564, lr_0 = 9.9436e-04
Validation auc = 0.717696
Epoch 8072
Loss = 4.5146e-02, PNorm = 487.9752, GNorm = 0.7039, lr_0 = 9.9436e-04
Validation auc = 0.725256
Epoch 8073
Loss = 2.1226e-02, PNorm = 488.0158, GNorm = 0.3532, lr_0 = 9.9436e-04
Validation auc = 0.722274
Epoch 8074
Loss = 6.1840e-03, PNorm = 488.0496, GNorm = 0.0940, lr_0 = 9.9436e-04
Validation auc = 0.717075
Epoch 8075
Loss = 1.3622e-02, PNorm = 488.0797, GNorm = 0.1588, lr_0 = 9.9436e-04
Validation auc = 0.722717
Epoch 8076
Loss = 1.8061e-02, PNorm = 488.1038, GNorm = 3.8555, lr_0 = 9.9436e-04
Validation auc = 0.726205
Epoch 8077
Loss = 7.0177e-02, PNorm = 488.1265, GNorm = 0.1725, lr_0 = 9.9436e-04
Validation auc = 0.726142
Epoch 8078
Loss = 4.4620e-04, PNorm = 488.1520, GNorm = 0.0467, lr_0 = 9.9436e-04
Validation auc = 0.719178
Epoch 8079
Loss = 3.4085e-02, PNorm = 488.1746, GNorm = 0.8894, lr_0 = 9.9436e-04
Loss = 1.3493e-02, PNorm = 488.1976, GNorm = 0.6535, lr_0 = 9.9436e-04
Validation auc = 0.713186
Epoch 8080
Loss = 4.0457e-02, PNorm = 488.2241, GNorm = 0.0581, lr_0 = 9.9436e-04
Validation auc = 0.709262
Epoch 8081
Loss = 1.4084e-02, PNorm = 488.2546, GNorm = 0.0991, lr_0 = 9.9436e-04
Validation auc = 0.706783
Epoch 8082
Loss = 2.8952e-02, PNorm = 488.2797, GNorm = 2.1962, lr_0 = 9.9436e-04
Validation auc = 0.699401
Epoch 8083
Loss = 6.2623e-03, PNorm = 488.3058, GNorm = 0.1645, lr_0 = 9.9435e-04
Validation auc = 0.701174
Epoch 8084
Loss = 3.8666e-02, PNorm = 488.3279, GNorm = 0.0717, lr_0 = 9.9435e-04
Validation auc = 0.706028
Epoch 8085
Loss = 2.6262e-02, PNorm = 488.3474, GNorm = 1.0036, lr_0 = 9.9435e-04
Validation auc = 0.708359
Epoch 8086
Loss = 2.1224e-03, PNorm = 488.3753, GNorm = 0.0387, lr_0 = 9.9435e-04
Validation auc = 0.708956
Epoch 8087
Loss = 1.2213e-02, PNorm = 488.4023, GNorm = 1.5544, lr_0 = 9.9435e-04
Validation auc = 0.706623
Epoch 8088
Loss = 3.3487e-03, PNorm = 488.4291, GNorm = 0.2548, lr_0 = 9.9435e-04
Validation auc = 0.711238
Epoch 8089
Loss = 7.7474e-04, PNorm = 488.4560, GNorm = 0.0481, lr_0 = 9.9435e-04
Loss = 1.9269e-02, PNorm = 488.4856, GNorm = 1.2427, lr_0 = 9.9435e-04
Validation auc = 0.719496
Epoch 8090
Loss = 2.8736e-02, PNorm = 488.5103, GNorm = 0.2031, lr_0 = 9.9435e-04
Validation auc = 0.721933
Epoch 8091
Loss = 4.2643e-02, PNorm = 488.5335, GNorm = 6.9957, lr_0 = 9.9435e-04
Validation auc = 0.726812
Epoch 8092
Loss = 8.1344e-03, PNorm = 488.5668, GNorm = 0.5521, lr_0 = 9.9435e-04
Validation auc = 0.733233
Epoch 8093
Loss = 1.9831e-02, PNorm = 488.5930, GNorm = 2.0870, lr_0 = 9.9435e-04
Validation auc = 0.727701
Epoch 8094
Loss = 2.5946e-02, PNorm = 488.6182, GNorm = 0.0689, lr_0 = 9.9435e-04
Validation auc = 0.726225
Epoch 8095
Loss = 1.4126e-02, PNorm = 488.6413, GNorm = 0.1293, lr_0 = 9.9435e-04
Validation auc = 0.728568
Epoch 8096
Loss = 6.2581e-03, PNorm = 488.6601, GNorm = 0.0660, lr_0 = 9.9434e-04
Validation auc = 0.726180
Epoch 8097
Loss = 3.5389e-03, PNorm = 488.6753, GNorm = 0.0912, lr_0 = 9.9434e-04
Validation auc = 0.721564
Epoch 8098
Loss = 2.6894e-03, PNorm = 488.6856, GNorm = 0.2192, lr_0 = 9.9434e-04
Validation auc = 0.725964
Epoch 8099
Loss = 2.7998e-03, PNorm = 488.6999, GNorm = 0.1417, lr_0 = 9.9434e-04
Loss = 2.4538e-02, PNorm = 488.7190, GNorm = 0.0583, lr_0 = 9.9434e-04
Validation auc = 0.741473
Epoch 8100
Loss = 5.1814e-02, PNorm = 488.7405, GNorm = 0.8666, lr_0 = 9.9434e-04
Validation auc = 0.744065
Epoch 8101
Loss = 1.1705e-02, PNorm = 488.7602, GNorm = 0.4017, lr_0 = 9.9434e-04
Validation auc = 0.738093
Epoch 8102
Loss = 1.1687e-02, PNorm = 488.7794, GNorm = 0.0626, lr_0 = 9.9434e-04
Validation auc = 0.731333
Epoch 8103
Loss = 4.4342e-03, PNorm = 488.8038, GNorm = 0.0240, lr_0 = 9.9434e-04
Validation auc = 0.729310
Epoch 8104
Loss = 6.7983e-03, PNorm = 488.8263, GNorm = 0.1060, lr_0 = 9.9434e-04
Validation auc = 0.728451
Epoch 8105
Loss = 4.4614e-02, PNorm = 488.8437, GNorm = 0.1274, lr_0 = 9.9434e-04
Validation auc = 0.726542
Epoch 8106
Loss = 1.6477e-02, PNorm = 488.8722, GNorm = 0.1238, lr_0 = 9.9434e-04
Validation auc = 0.718380
Epoch 8107
Loss = 3.2195e-02, PNorm = 488.9006, GNorm = 4.2448, lr_0 = 9.9434e-04
Validation auc = 0.707028
Epoch 8108
Loss = 5.5405e-02, PNorm = 488.9303, GNorm = 0.5133, lr_0 = 9.9434e-04
Validation auc = 0.698276
Epoch 8109
Loss = 2.6177e-03, PNorm = 488.9636, GNorm = 0.0959, lr_0 = 9.9434e-04
Loss = 1.0185e-02, PNorm = 488.9926, GNorm = 0.2763, lr_0 = 9.9433e-04
Validation auc = 0.696561
Epoch 8110
Loss = 2.9107e-02, PNorm = 489.0146, GNorm = 0.0230, lr_0 = 9.9433e-04
Validation auc = 0.700216
Epoch 8111
Loss = 4.4639e-02, PNorm = 489.0464, GNorm = 0.0243, lr_0 = 9.9433e-04
Validation auc = 0.706329
Epoch 8112
Loss = 4.7384e-02, PNorm = 489.0905, GNorm = 1.5785, lr_0 = 9.9433e-04
Validation auc = 0.716453
Epoch 8113
Loss = 5.3861e-02, PNorm = 489.1412, GNorm = 3.5137, lr_0 = 9.9433e-04
Validation auc = 0.714805
Epoch 8114
Loss = 2.8238e-02, PNorm = 489.1905, GNorm = 1.5083, lr_0 = 9.9433e-04
Validation auc = 0.709607
Epoch 8115
Loss = 2.7821e-02, PNorm = 489.2250, GNorm = 0.6384, lr_0 = 9.9433e-04
Validation auc = 0.710902
Epoch 8116
Loss = 6.8012e-03, PNorm = 489.2564, GNorm = 0.0798, lr_0 = 9.9433e-04
Validation auc = 0.715643
Epoch 8117
Loss = 3.4860e-02, PNorm = 489.2851, GNorm = 0.1976, lr_0 = 9.9433e-04
Validation auc = 0.712940
Epoch 8118
Loss = 3.7131e-03, PNorm = 489.3170, GNorm = 0.2898, lr_0 = 9.9433e-04
Validation auc = 0.705896
Epoch 8119
Loss = 9.8985e-03, PNorm = 489.3459, GNorm = 0.3155, lr_0 = 9.9433e-04
Loss = 3.5429e-02, PNorm = 489.3743, GNorm = 1.6356, lr_0 = 9.9433e-04
Validation auc = 0.705938
Epoch 8120
Loss = 1.3940e-02, PNorm = 489.4035, GNorm = 0.0982, lr_0 = 9.9433e-04
Validation auc = 0.705700
Epoch 8121
Loss = 9.2872e-03, PNorm = 489.4321, GNorm = 0.2235, lr_0 = 9.9433e-04
Validation auc = 0.709906
Epoch 8122
Loss = 6.1446e-03, PNorm = 489.4510, GNorm = 1.7622, lr_0 = 9.9432e-04
Validation auc = 0.709684
Epoch 8123
Loss = 2.1889e-02, PNorm = 489.4720, GNorm = 2.2011, lr_0 = 9.9432e-04
Validation auc = 0.705909
Epoch 8124
Loss = 2.1920e-02, PNorm = 489.4951, GNorm = 0.3107, lr_0 = 9.9432e-04
Validation auc = 0.709410
Epoch 8125
Loss = 1.4727e-02, PNorm = 489.5199, GNorm = 0.0604, lr_0 = 9.9432e-04
Validation auc = 0.709927
Epoch 8126
Loss = 1.7473e-02, PNorm = 489.5409, GNorm = 0.2680, lr_0 = 9.9432e-04
Validation auc = 0.711195
Epoch 8127
Loss = 8.8715e-02, PNorm = 489.5580, GNorm = 0.0543, lr_0 = 9.9432e-04
Validation auc = 0.709866
Epoch 8128
Loss = 2.1240e-02, PNorm = 489.5973, GNorm = 0.7174, lr_0 = 9.9432e-04
Validation auc = 0.711717
Epoch 8129
Loss = 2.1744e-01, PNorm = 489.6400, GNorm = 5.6599, lr_0 = 9.9432e-04
Loss = 2.8395e-02, PNorm = 489.6801, GNorm = 1.2319, lr_0 = 9.9432e-04
Validation auc = 0.701537
Epoch 8130
Loss = 4.5859e-02, PNorm = 489.7251, GNorm = 0.1089, lr_0 = 9.9432e-04
Validation auc = 0.698310
Epoch 8131
Loss = 2.7086e-02, PNorm = 489.7583, GNorm = 0.8340, lr_0 = 9.9432e-04
Validation auc = 0.699196
Epoch 8132
Loss = 1.6683e-02, PNorm = 489.7830, GNorm = 0.7180, lr_0 = 9.9432e-04
Validation auc = 0.702899
Epoch 8133
Loss = 4.0219e-02, PNorm = 489.8098, GNorm = 1.0370, lr_0 = 9.9432e-04
Validation auc = 0.705515
Epoch 8134
Loss = 1.7391e-02, PNorm = 489.8325, GNorm = 0.0975, lr_0 = 9.9432e-04
Validation auc = 0.705865
Epoch 8135
Loss = 1.0883e-01, PNorm = 489.8512, GNorm = 6.6605, lr_0 = 9.9432e-04
Validation auc = 0.708211
Epoch 8136
Loss = 9.6796e-03, PNorm = 489.8855, GNorm = 0.1585, lr_0 = 9.9431e-04
Validation auc = 0.706878
Epoch 8137
Loss = 4.1826e-03, PNorm = 489.9163, GNorm = 0.4553, lr_0 = 9.9431e-04
Validation auc = 0.709660
Epoch 8138
Loss = 2.2624e-03, PNorm = 489.9356, GNorm = 0.0019, lr_0 = 9.9431e-04
Validation auc = 0.715035
Epoch 8139
Loss = 4.8587e-04, PNorm = 489.9652, GNorm = 0.0259, lr_0 = 9.9431e-04
Loss = 6.3359e-02, PNorm = 490.0130, GNorm = 1.6012, lr_0 = 9.9431e-04
Validation auc = 0.709089
Epoch 8140
Loss = 6.2319e-02, PNorm = 490.0698, GNorm = 0.3918, lr_0 = 9.9431e-04
Validation auc = 0.714604
Epoch 8141
Loss = 1.4993e-02, PNorm = 490.1117, GNorm = 1.1458, lr_0 = 9.9431e-04
Validation auc = 0.720818
Epoch 8142
Loss = 2.5537e-02, PNorm = 490.1404, GNorm = 2.0340, lr_0 = 9.9431e-04
Validation auc = 0.725059
Epoch 8143
Loss = 6.4321e-02, PNorm = 490.1759, GNorm = 2.5446, lr_0 = 9.9431e-04
Validation auc = 0.727974
Epoch 8144
Loss = 8.0671e-02, PNorm = 490.2106, GNorm = 0.6810, lr_0 = 9.9431e-04
Validation auc = 0.734703
Epoch 8145
Loss = 5.1570e-02, PNorm = 490.2427, GNorm = 0.1055, lr_0 = 9.9431e-04
Validation auc = 0.733889
Epoch 8146
Loss = 6.2227e-03, PNorm = 490.2758, GNorm = 0.1431, lr_0 = 9.9431e-04
Validation auc = 0.733071
Epoch 8147
Loss = 2.0522e-02, PNorm = 490.3022, GNorm = 0.4912, lr_0 = 9.9431e-04
Validation auc = 0.730708
Epoch 8148
Loss = 8.0803e-03, PNorm = 490.3239, GNorm = 0.2556, lr_0 = 9.9431e-04
Validation auc = 0.730124
Epoch 8149
Loss = 1.2942e-03, PNorm = 490.3393, GNorm = 0.0668, lr_0 = 9.9431e-04
Loss = 1.3283e-02, PNorm = 490.3557, GNorm = 0.5335, lr_0 = 9.9430e-04
Validation auc = 0.720147
Epoch 8150
Loss = 2.9432e-02, PNorm = 490.3723, GNorm = 2.3034, lr_0 = 9.9430e-04
Validation auc = 0.726531
Epoch 8151
Loss = 2.0902e-02, PNorm = 490.3955, GNorm = 0.5862, lr_0 = 9.9430e-04
Validation auc = 0.729118
Epoch 8152
Loss = 6.8953e-03, PNorm = 490.4217, GNorm = 0.1840, lr_0 = 9.9430e-04
Validation auc = 0.730893
Epoch 8153
Loss = 1.2525e-02, PNorm = 490.4427, GNorm = 1.3153, lr_0 = 9.9430e-04
Validation auc = 0.730561
Epoch 8154
Loss = 2.3962e-02, PNorm = 490.4611, GNorm = 0.2096, lr_0 = 9.9430e-04
Validation auc = 0.734105
Epoch 8155
Loss = 2.9917e-02, PNorm = 490.4756, GNorm = 1.7703, lr_0 = 9.9430e-04
Validation auc = 0.730958
Epoch 8156
Loss = 4.3923e-03, PNorm = 490.4871, GNorm = 0.2184, lr_0 = 9.9430e-04
Validation auc = 0.725577
Epoch 8157
Loss = 6.8481e-03, PNorm = 490.5050, GNorm = 0.3077, lr_0 = 9.9430e-04
Validation auc = 0.722225
Epoch 8158
Loss = 3.9356e-02, PNorm = 490.5240, GNorm = 1.0250, lr_0 = 9.9430e-04
Validation auc = 0.724639
Epoch 8159
Loss = 3.1993e-02, PNorm = 490.5465, GNorm = 1.7253, lr_0 = 9.9430e-04
Loss = 1.1113e-02, PNorm = 490.5670, GNorm = 0.2692, lr_0 = 9.9430e-04
Validation auc = 0.730852
Epoch 8160
Loss = 2.4331e-02, PNorm = 490.5859, GNorm = 0.0822, lr_0 = 9.9430e-04
Validation auc = 0.732218
Epoch 8161
Loss = 1.5026e-02, PNorm = 490.6128, GNorm = 0.0881, lr_0 = 9.9430e-04
Validation auc = 0.732776
Epoch 8162
Loss = 1.3573e-02, PNorm = 490.6409, GNorm = 0.1998, lr_0 = 9.9429e-04
Validation auc = 0.736028
Epoch 8163
Loss = 1.2215e-01, PNorm = 490.6780, GNorm = 0.6445, lr_0 = 9.9429e-04
Validation auc = 0.740539
Epoch 8164
Loss = 1.5770e-02, PNorm = 490.7178, GNorm = 0.9791, lr_0 = 9.9429e-04
Validation auc = 0.739316
Epoch 8165
Loss = 3.9123e-02, PNorm = 490.7461, GNorm = 1.6473, lr_0 = 9.9429e-04
Validation auc = 0.731732
Epoch 8166
Loss = 3.0004e-02, PNorm = 490.7759, GNorm = 2.3294, lr_0 = 9.9429e-04
Validation auc = 0.731898
Epoch 8167
Loss = 2.5149e-02, PNorm = 490.8099, GNorm = 0.7290, lr_0 = 9.9429e-04
Validation auc = 0.732012
Epoch 8168
Loss = 3.3106e-02, PNorm = 490.8393, GNorm = 0.9591, lr_0 = 9.9429e-04
Validation auc = 0.730323
Epoch 8169
Loss = 6.2787e-04, PNorm = 490.8652, GNorm = 0.0419, lr_0 = 9.9429e-04
Loss = 1.3807e-02, PNorm = 490.8864, GNorm = 0.7296, lr_0 = 9.9429e-04
Validation auc = 0.726647
Epoch 8170
Loss = 3.3382e-02, PNorm = 490.9108, GNorm = 1.4433, lr_0 = 9.9429e-04
Validation auc = 0.731615
Epoch 8171
Loss = 3.4363e-02, PNorm = 490.9397, GNorm = 0.1343, lr_0 = 9.9429e-04
Validation auc = 0.735426
Epoch 8172
Loss = 1.4799e-02, PNorm = 490.9668, GNorm = 0.2406, lr_0 = 9.9429e-04
Validation auc = 0.734661
Epoch 8173
Loss = 1.7166e-02, PNorm = 490.9904, GNorm = 0.9057, lr_0 = 9.9429e-04
Validation auc = 0.735756
Epoch 8174
Loss = 1.3703e-02, PNorm = 491.0167, GNorm = 1.2934, lr_0 = 9.9429e-04
Validation auc = 0.739180
Epoch 8175
Loss = 3.4488e-02, PNorm = 491.0490, GNorm = 1.1790, lr_0 = 9.9429e-04
Validation auc = 0.739895
Epoch 8176
Loss = 1.8909e-02, PNorm = 491.0870, GNorm = 1.0876, lr_0 = 9.9428e-04
Validation auc = 0.739278
Epoch 8177
Loss = 4.1020e-02, PNorm = 491.1225, GNorm = 2.9490, lr_0 = 9.9428e-04
Validation auc = 0.736339
Epoch 8178
Loss = 4.4770e-02, PNorm = 491.1562, GNorm = 1.4643, lr_0 = 9.9428e-04
Validation auc = 0.733943
Epoch 8179
Loss = 1.5614e-01, PNorm = 491.1861, GNorm = 3.1426, lr_0 = 9.9428e-04
Loss = 4.3431e-02, PNorm = 491.2166, GNorm = 4.2121, lr_0 = 9.9428e-04
Validation auc = 0.731566
Epoch 8180
Loss = 2.0855e-02, PNorm = 491.2526, GNorm = 1.6362, lr_0 = 9.9428e-04
Validation auc = 0.733296
Epoch 8181
Loss = 1.9361e-02, PNorm = 491.2890, GNorm = 1.7916, lr_0 = 9.9428e-04
Validation auc = 0.734905
Epoch 8182
Loss = 9.3140e-03, PNorm = 491.3183, GNorm = 0.1428, lr_0 = 9.9428e-04
Validation auc = 0.733488
Epoch 8183
Loss = 5.6911e-03, PNorm = 491.3343, GNorm = 0.6020, lr_0 = 9.9428e-04
Validation auc = 0.733298
Epoch 8184
Loss = 4.4797e-02, PNorm = 491.3474, GNorm = 3.1030, lr_0 = 9.9428e-04
Validation auc = 0.732908
Epoch 8185
Loss = 2.0773e-02, PNorm = 491.3628, GNorm = 0.0232, lr_0 = 9.9428e-04
Validation auc = 0.733890
Epoch 8186
Loss = 1.8844e-02, PNorm = 491.3828, GNorm = 0.9525, lr_0 = 9.9428e-04
Validation auc = 0.731370
Epoch 8187
Loss = 5.7585e-03, PNorm = 491.4062, GNorm = 0.0852, lr_0 = 9.9428e-04
Validation auc = 0.727104
Epoch 8188
Loss = 1.2075e-02, PNorm = 491.4322, GNorm = 0.6242, lr_0 = 9.9428e-04
Validation auc = 0.723258
Epoch 8189
Loss = 1.6947e-02, PNorm = 491.4546, GNorm = 0.7931, lr_0 = 9.9427e-04
Loss = 5.8049e-03, PNorm = 491.4709, GNorm = 0.7199, lr_0 = 9.9427e-04
Validation auc = 0.722754
Epoch 8190
Loss = 4.0085e-02, PNorm = 491.4850, GNorm = 1.0226, lr_0 = 9.9427e-04
Validation auc = 0.728933
Epoch 8191
Loss = 3.0711e-02, PNorm = 491.5223, GNorm = 0.9274, lr_0 = 9.9427e-04
Validation auc = 0.726021
Epoch 8192
Loss = 7.5093e-03, PNorm = 491.5628, GNorm = 0.1182, lr_0 = 9.9427e-04
Validation auc = 0.722827
Epoch 8193
Loss = 4.8804e-02, PNorm = 491.5914, GNorm = 1.5341, lr_0 = 9.9427e-04
Validation auc = 0.716603
Epoch 8194
Loss = 7.0498e-02, PNorm = 491.6215, GNorm = 0.8346, lr_0 = 9.9427e-04
Validation auc = 0.715521
Epoch 8195
Loss = 5.3613e-02, PNorm = 491.6598, GNorm = 3.2939, lr_0 = 9.9427e-04
Validation auc = 0.719589
Epoch 8196
Loss = 1.8451e-02, PNorm = 491.7058, GNorm = 0.7501, lr_0 = 9.9427e-04
Validation auc = 0.720468
Epoch 8197
Loss = 1.1168e-02, PNorm = 491.7430, GNorm = 0.8894, lr_0 = 9.9427e-04
Validation auc = 0.721154
Epoch 8198
Loss = 9.7387e-04, PNorm = 491.7732, GNorm = 0.0386, lr_0 = 9.9427e-04
Validation auc = 0.724307
Epoch 8199
Loss = 2.1579e-03, PNorm = 491.8040, GNorm = 0.0846, lr_0 = 9.9427e-04
Loss = 2.7669e-02, PNorm = 491.8275, GNorm = 0.5197, lr_0 = 9.9427e-04
Validation auc = 0.727383
Epoch 8200
Loss = 1.9973e-02, PNorm = 491.8544, GNorm = 0.5280, lr_0 = 9.9427e-04
Validation auc = 0.730853
Epoch 8201
Loss = 2.2038e-02, PNorm = 491.8822, GNorm = 0.1009, lr_0 = 9.9427e-04
Validation auc = 0.736371
Epoch 8202
Loss = 1.3729e-02, PNorm = 491.9071, GNorm = 0.8496, lr_0 = 9.9426e-04
Validation auc = 0.735045
Epoch 8203
Loss = 1.7317e-02, PNorm = 491.9273, GNorm = 0.7133, lr_0 = 9.9426e-04
Validation auc = 0.733805
Epoch 8204
Loss = 4.6444e-02, PNorm = 491.9551, GNorm = 0.0600, lr_0 = 9.9426e-04
Validation auc = 0.739289
Epoch 8205
Loss = 1.0159e-02, PNorm = 491.9887, GNorm = 0.2787, lr_0 = 9.9426e-04
Validation auc = 0.736048
Epoch 8206
Loss = 4.7930e-02, PNorm = 492.0177, GNorm = 2.3588, lr_0 = 9.9426e-04
Validation auc = 0.738262
Epoch 8207
Loss = 1.6848e-02, PNorm = 492.0507, GNorm = 0.7187, lr_0 = 9.9426e-04
Validation auc = 0.733412
Epoch 8208
Loss = 7.5328e-03, PNorm = 492.0773, GNorm = 0.1063, lr_0 = 9.9426e-04
Validation auc = 0.729001
Epoch 8209
Loss = 5.0136e-03, PNorm = 492.0988, GNorm = 0.2275, lr_0 = 9.9426e-04
Loss = 3.2826e-02, PNorm = 492.1252, GNorm = 3.0516, lr_0 = 9.9426e-04
Validation auc = 0.728377
Epoch 8210
Loss = 2.0738e-02, PNorm = 492.1581, GNorm = 0.0405, lr_0 = 9.9426e-04
Validation auc = 0.725769
Epoch 8211
Loss = 3.0013e-02, PNorm = 492.1842, GNorm = 0.1016, lr_0 = 9.9426e-04
Validation auc = 0.723244
Epoch 8212
Loss = 2.2805e-02, PNorm = 492.2046, GNorm = 2.1456, lr_0 = 9.9426e-04
Validation auc = 0.725688
Epoch 8213
Loss = 6.3469e-03, PNorm = 492.2190, GNorm = 0.0541, lr_0 = 9.9426e-04
Validation auc = 0.725763
Epoch 8214
Loss = 2.6079e-02, PNorm = 492.2338, GNorm = 0.5430, lr_0 = 9.9426e-04
Validation auc = 0.730768
Epoch 8215
Loss = 2.3658e-02, PNorm = 492.2578, GNorm = 0.1698, lr_0 = 9.9426e-04
Validation auc = 0.734876
Epoch 8216
Loss = 2.7554e-02, PNorm = 492.2796, GNorm = 1.9079, lr_0 = 9.9425e-04
Validation auc = 0.739029
Epoch 8217
Loss = 9.5409e-03, PNorm = 492.3058, GNorm = 1.0476, lr_0 = 9.9425e-04
Validation auc = 0.732397
Epoch 8218
Loss = 1.5168e-03, PNorm = 492.3337, GNorm = 0.0348, lr_0 = 9.9425e-04
Validation auc = 0.731087
Epoch 8219
Loss = 6.2052e-03, PNorm = 492.3515, GNorm = 0.3008, lr_0 = 9.9425e-04
Loss = 3.3252e-02, PNorm = 492.3703, GNorm = 0.3383, lr_0 = 9.9425e-04
Validation auc = 0.723713
Epoch 8220
Loss = 4.0334e-02, PNorm = 492.4002, GNorm = 7.0189, lr_0 = 9.9425e-04
Validation auc = 0.720036
Epoch 8221
Loss = 1.0789e-02, PNorm = 492.4334, GNorm = 2.5302, lr_0 = 9.9425e-04
Validation auc = 0.722805
Epoch 8222
Loss = 7.9889e-03, PNorm = 492.4612, GNorm = 0.0639, lr_0 = 9.9425e-04
Validation auc = 0.731717
Epoch 8223
Loss = 8.6850e-03, PNorm = 492.4815, GNorm = 0.8171, lr_0 = 9.9425e-04
Validation auc = 0.733611
Epoch 8224
Loss = 4.6568e-02, PNorm = 492.4971, GNorm = 3.2887, lr_0 = 9.9425e-04
Validation auc = 0.727024
Epoch 8225
Loss = 3.5870e-02, PNorm = 492.5157, GNorm = 3.2256, lr_0 = 9.9425e-04
Validation auc = 0.724122
Epoch 8226
Loss = 8.0749e-03, PNorm = 492.5388, GNorm = 0.0189, lr_0 = 9.9425e-04
Validation auc = 0.723226
Epoch 8227
Loss = 2.1823e-03, PNorm = 492.5562, GNorm = 0.1654, lr_0 = 9.9425e-04
Validation auc = 0.726353
Epoch 8228
Loss = 7.5953e-03, PNorm = 492.5746, GNorm = 0.3681, lr_0 = 9.9425e-04
Validation auc = 0.726659
Epoch 8229
Loss = 3.1984e-03, PNorm = 492.5900, GNorm = 0.1105, lr_0 = 9.9424e-04
Loss = 5.9701e-02, PNorm = 492.6177, GNorm = 4.9294, lr_0 = 9.9424e-04
Validation auc = 0.725176
Epoch 8230
Loss = 2.8953e-02, PNorm = 492.6639, GNorm = 0.4030, lr_0 = 9.9424e-04
Validation auc = 0.722250
Epoch 8231
Loss = 1.1820e-02, PNorm = 492.6946, GNorm = 2.4040, lr_0 = 9.9424e-04
Validation auc = 0.720789
Epoch 8232
Loss = 5.6430e-02, PNorm = 492.7222, GNorm = 0.3002, lr_0 = 9.9424e-04
Validation auc = 0.723380
Epoch 8233
Loss = 1.4751e-02, PNorm = 492.7439, GNorm = 0.1816, lr_0 = 9.9424e-04
Validation auc = 0.727750
Epoch 8234
Loss = 9.9981e-03, PNorm = 492.7697, GNorm = 0.9528, lr_0 = 9.9424e-04
Validation auc = 0.732326
Epoch 8235
Loss = 7.4717e-02, PNorm = 492.7985, GNorm = 2.2840, lr_0 = 9.9424e-04
Validation auc = 0.725129
Epoch 8236
Loss = 1.8600e-02, PNorm = 492.8270, GNorm = 0.1587, lr_0 = 9.9424e-04
Validation auc = 0.725412
Epoch 8237
Loss = 8.6325e-03, PNorm = 492.8512, GNorm = 0.2980, lr_0 = 9.9424e-04
Validation auc = 0.728178
Epoch 8238
Loss = 4.7740e-03, PNorm = 492.8766, GNorm = 0.0823, lr_0 = 9.9424e-04
Validation auc = 0.731927
Epoch 8239
Loss = 1.8783e-03, PNorm = 492.9024, GNorm = 0.0841, lr_0 = 9.9424e-04
Loss = 3.1834e-02, PNorm = 492.9245, GNorm = 1.0827, lr_0 = 9.9424e-04
Validation auc = 0.732103
Epoch 8240
Loss = 1.4026e-02, PNorm = 492.9433, GNorm = 0.2474, lr_0 = 9.9424e-04
Validation auc = 0.728974
Epoch 8241
Loss = 2.2722e-02, PNorm = 492.9635, GNorm = 0.6046, lr_0 = 9.9424e-04
Validation auc = 0.732469
Epoch 8242
Loss = 4.6725e-02, PNorm = 492.9946, GNorm = 0.1065, lr_0 = 9.9423e-04
Validation auc = 0.729368
Epoch 8243
Loss = 2.3812e-02, PNorm = 493.0337, GNorm = 0.8358, lr_0 = 9.9423e-04
Validation auc = 0.733371
Epoch 8244
Loss = 2.4978e-02, PNorm = 493.0702, GNorm = 0.0649, lr_0 = 9.9423e-04
Validation auc = 0.732377
Epoch 8245
Loss = 1.0650e-02, PNorm = 493.1000, GNorm = 0.7935, lr_0 = 9.9423e-04
Validation auc = 0.733833
Epoch 8246
Loss = 2.4002e-02, PNorm = 493.1212, GNorm = 0.0296, lr_0 = 9.9423e-04
Validation auc = 0.740856
Epoch 8247
Loss = 7.5476e-03, PNorm = 493.1417, GNorm = 0.9631, lr_0 = 9.9423e-04
Validation auc = 0.737691
Epoch 8248
Loss = 4.2588e-03, PNorm = 493.1642, GNorm = 0.0783, lr_0 = 9.9423e-04
Validation auc = 0.741406
Epoch 8249
Loss = 3.7212e-02, PNorm = 493.1854, GNorm = 3.2947, lr_0 = 9.9423e-04
Loss = 2.3031e-02, PNorm = 493.2046, GNorm = 1.3920, lr_0 = 9.9423e-04
Validation auc = 0.737575
Epoch 8250
Loss = 6.4854e-03, PNorm = 493.2237, GNorm = 1.7709, lr_0 = 9.9423e-04
Validation auc = 0.739064
Epoch 8251
Loss = 2.8403e-02, PNorm = 493.2419, GNorm = 1.5822, lr_0 = 9.9423e-04
Validation auc = 0.732718
Epoch 8252
Loss = 1.6462e-02, PNorm = 493.2611, GNorm = 0.0090, lr_0 = 9.9423e-04
Validation auc = 0.738817
Epoch 8253
Loss = 2.9431e-02, PNorm = 493.2812, GNorm = 2.2841, lr_0 = 9.9423e-04
Validation auc = 0.741809
Epoch 8254
Loss = 5.0120e-02, PNorm = 493.3092, GNorm = 0.0945, lr_0 = 9.9423e-04
Validation auc = 0.741703
Epoch 8255
Loss = 7.1085e-03, PNorm = 493.3387, GNorm = 0.3500, lr_0 = 9.9422e-04
Validation auc = 0.738509
Epoch 8256
Loss = 1.3756e-02, PNorm = 493.3576, GNorm = 0.0918, lr_0 = 9.9422e-04
Validation auc = 0.740290
Epoch 8257
Loss = 4.0357e-03, PNorm = 493.3730, GNorm = 0.3691, lr_0 = 9.9422e-04
Validation auc = 0.739995
Epoch 8258
Loss = 4.0223e-02, PNorm = 493.3858, GNorm = 1.3532, lr_0 = 9.9422e-04
Validation auc = 0.743279
Epoch 8259
Loss = 3.3526e-02, PNorm = 493.4039, GNorm = 0.8634, lr_0 = 9.9422e-04
Loss = 2.0168e-02, PNorm = 493.4249, GNorm = 0.0916, lr_0 = 9.9422e-04
Validation auc = 0.745067
Epoch 8260
Loss = 1.0308e-02, PNorm = 493.4387, GNorm = 0.0671, lr_0 = 9.9422e-04
Validation auc = 0.746089
Epoch 8261
Loss = 1.4340e-02, PNorm = 493.4533, GNorm = 0.0249, lr_0 = 9.9422e-04
Validation auc = 0.745686
Epoch 8262
Loss = 5.2733e-02, PNorm = 493.4834, GNorm = 1.3230, lr_0 = 9.9422e-04
Validation auc = 0.740232
Epoch 8263
Loss = 2.0819e-02, PNorm = 493.5192, GNorm = 2.5121, lr_0 = 9.9422e-04
Validation auc = 0.734939
Epoch 8264
Loss = 6.7264e-02, PNorm = 493.5541, GNorm = 0.0477, lr_0 = 9.9422e-04
Validation auc = 0.744495
Epoch 8265
Loss = 4.8710e-03, PNorm = 493.5892, GNorm = 0.0104, lr_0 = 9.9422e-04
Validation auc = 0.746075
Epoch 8266
Loss = 2.5464e-02, PNorm = 493.6145, GNorm = 0.4543, lr_0 = 9.9422e-04
Validation auc = 0.748991
Epoch 8267
Loss = 1.7860e-02, PNorm = 493.6419, GNorm = 0.0538, lr_0 = 9.9422e-04
Validation auc = 0.749966
Epoch 8268
Loss = 1.0555e-02, PNorm = 493.6688, GNorm = 0.4241, lr_0 = 9.9422e-04
Validation auc = 0.749417
Epoch 8269
Loss = 3.8649e-02, PNorm = 493.6912, GNorm = 1.6670, lr_0 = 9.9421e-04
Loss = 4.7221e-02, PNorm = 493.7137, GNorm = 7.6239, lr_0 = 9.9421e-04
Validation auc = 0.753170
Epoch 8270
Loss = 2.6816e-02, PNorm = 493.7418, GNorm = 1.6211, lr_0 = 9.9421e-04
Validation auc = 0.749699
Epoch 8271
Loss = 3.3468e-02, PNorm = 493.7673, GNorm = 2.3659, lr_0 = 9.9421e-04
Validation auc = 0.746379
Epoch 8272
Loss = 2.5048e-02, PNorm = 493.7915, GNorm = 0.2190, lr_0 = 9.9421e-04
Validation auc = 0.745130
Epoch 8273
Loss = 5.2547e-02, PNorm = 493.8193, GNorm = 0.4260, lr_0 = 9.9421e-04
Validation auc = 0.746297
Epoch 8274
Loss = 2.7990e-02, PNorm = 493.8488, GNorm = 0.1382, lr_0 = 9.9421e-04
Validation auc = 0.742405
Epoch 8275
Loss = 1.1967e-02, PNorm = 493.8721, GNorm = 1.0422, lr_0 = 9.9421e-04
Validation auc = 0.741084
Epoch 8276
Loss = 8.4318e-02, PNorm = 493.8959, GNorm = 0.1823, lr_0 = 9.9421e-04
Validation auc = 0.746345
Epoch 8277
Loss = 4.6402e-02, PNorm = 493.9296, GNorm = 0.2389, lr_0 = 9.9421e-04
Validation auc = 0.739559
Epoch 8278
Loss = 5.2936e-02, PNorm = 493.9710, GNorm = 2.2862, lr_0 = 9.9421e-04
Validation auc = 0.740493
Epoch 8279
Loss = 3.3564e-02, PNorm = 494.0211, GNorm = 1.6011, lr_0 = 9.9421e-04
Loss = 4.1742e-02, PNorm = 494.0756, GNorm = 0.3479, lr_0 = 9.9421e-04
Validation auc = 0.741821
Epoch 8280
Loss = 2.2298e-02, PNorm = 494.1195, GNorm = 0.3166, lr_0 = 9.9421e-04
Validation auc = 0.743399
Epoch 8281
Loss = 1.1656e-02, PNorm = 494.1452, GNorm = 0.2663, lr_0 = 9.9421e-04
Validation auc = 0.744324
Epoch 8282
Loss = 3.2138e-02, PNorm = 494.1655, GNorm = 0.1722, lr_0 = 9.9420e-04
Validation auc = 0.743720
Epoch 8283
Loss = 3.2397e-02, PNorm = 494.1849, GNorm = 3.8753, lr_0 = 9.9420e-04
Validation auc = 0.745157
Epoch 8284
Loss = 4.2939e-02, PNorm = 494.2189, GNorm = 1.6248, lr_0 = 9.9420e-04
Validation auc = 0.736146
Epoch 8285
Loss = 6.5936e-02, PNorm = 494.2483, GNorm = 1.4887, lr_0 = 9.9420e-04
Validation auc = 0.733909
Epoch 8286
Loss = 2.1752e-02, PNorm = 494.2817, GNorm = 0.8681, lr_0 = 9.9420e-04
Validation auc = 0.736216
Epoch 8287
Loss = 7.6854e-03, PNorm = 494.3155, GNorm = 0.5195, lr_0 = 9.9420e-04
Validation auc = 0.739796
Epoch 8288
Loss = 5.8375e-02, PNorm = 494.3379, GNorm = 0.0637, lr_0 = 9.9420e-04
Validation auc = 0.745280
Epoch 8289
Loss = 4.8752e-02, PNorm = 494.3546, GNorm = 1.7193, lr_0 = 9.9420e-04
Loss = 1.6267e-02, PNorm = 494.3715, GNorm = 0.3016, lr_0 = 9.9420e-04
Validation auc = 0.743441
Epoch 8290
Loss = 1.5749e-02, PNorm = 494.3900, GNorm = 0.4676, lr_0 = 9.9420e-04
Validation auc = 0.742221
Epoch 8291
Loss = 1.0401e-02, PNorm = 494.4071, GNorm = 0.2335, lr_0 = 9.9420e-04
Validation auc = 0.741876
Epoch 8292
Loss = 1.2539e-02, PNorm = 494.4300, GNorm = 0.8296, lr_0 = 9.9420e-04
Validation auc = 0.735576
Epoch 8293
Loss = 1.8567e-02, PNorm = 494.4547, GNorm = 0.3110, lr_0 = 9.9420e-04
Validation auc = 0.735769
Epoch 8294
Loss = 9.6988e-03, PNorm = 494.4742, GNorm = 1.9935, lr_0 = 9.9420e-04
Validation auc = 0.738459
Epoch 8295
Loss = 1.5431e-02, PNorm = 494.4927, GNorm = 0.1308, lr_0 = 9.9419e-04
Validation auc = 0.741116
Epoch 8296
Loss = 1.4160e-03, PNorm = 494.5149, GNorm = 0.0305, lr_0 = 9.9419e-04
Validation auc = 0.744294
Epoch 8297
Loss = 2.2748e-02, PNorm = 494.5315, GNorm = 2.5399, lr_0 = 9.9419e-04
Validation auc = 0.741472
Epoch 8298
Loss = 1.7201e-02, PNorm = 494.5564, GNorm = 1.3421, lr_0 = 9.9419e-04
Validation auc = 0.743353
Epoch 8299
Loss = 1.1485e-02, PNorm = 494.5901, GNorm = 1.1403, lr_0 = 9.9419e-04
Loss = 1.7265e-02, PNorm = 494.6175, GNorm = 0.0402, lr_0 = 9.9419e-04
Validation auc = 0.744629
Epoch 8300
Loss = 5.1738e-02, PNorm = 494.6584, GNorm = 0.1273, lr_0 = 9.9419e-04
Validation auc = 0.741019
Epoch 8301
Loss = 2.0408e-02, PNorm = 494.6969, GNorm = 0.9632, lr_0 = 9.9419e-04
Validation auc = 0.734207
Epoch 8302
Loss = 1.3974e-02, PNorm = 494.7244, GNorm = 0.1505, lr_0 = 9.9419e-04
Validation auc = 0.729290
Epoch 8303
Loss = 1.6870e-02, PNorm = 494.7428, GNorm = 0.1696, lr_0 = 9.9419e-04
Validation auc = 0.725235
Epoch 8304
Loss = 3.5018e-02, PNorm = 494.7649, GNorm = 0.0732, lr_0 = 9.9419e-04
Validation auc = 0.723930
Epoch 8305
Loss = 7.3249e-03, PNorm = 494.7876, GNorm = 0.3377, lr_0 = 9.9419e-04
Validation auc = 0.723001
Epoch 8306
Loss = 3.6793e-03, PNorm = 494.8043, GNorm = 0.2380, lr_0 = 9.9419e-04
Validation auc = 0.718142
Epoch 8307
Loss = 2.2177e-03, PNorm = 494.8179, GNorm = 0.1844, lr_0 = 9.9419e-04
Validation auc = 0.719466
Epoch 8308
Loss = 3.6282e-02, PNorm = 494.8411, GNorm = 0.2893, lr_0 = 9.9419e-04
Validation auc = 0.726878
Epoch 8309
Loss = 2.2683e-01, PNorm = 494.8769, GNorm = 11.0751, lr_0 = 9.9418e-04
Loss = 3.5160e-02, PNorm = 494.9322, GNorm = 1.0328, lr_0 = 9.9418e-04
Validation auc = 0.711329
Epoch 8310
Loss = 5.1457e-02, PNorm = 494.9857, GNorm = 0.1029, lr_0 = 9.9418e-04
Validation auc = 0.712021
Epoch 8311
Loss = 4.3329e-02, PNorm = 495.0309, GNorm = 0.2329, lr_0 = 9.9418e-04
Validation auc = 0.719009
Epoch 8312
Loss = 3.1055e-02, PNorm = 495.0721, GNorm = 0.1408, lr_0 = 9.9418e-04
Validation auc = 0.718967
Epoch 8313
Loss = 6.1776e-02, PNorm = 495.1111, GNorm = 0.3521, lr_0 = 9.9418e-04
Validation auc = 0.718346
Epoch 8314
Loss = 2.3435e-02, PNorm = 495.1447, GNorm = 0.1512, lr_0 = 9.9418e-04
Validation auc = 0.716087
Epoch 8315
Loss = 2.5871e-02, PNorm = 495.1822, GNorm = 0.9839, lr_0 = 9.9418e-04
Validation auc = 0.714777
Epoch 8316
Loss = 3.5417e-02, PNorm = 495.2175, GNorm = 0.2329, lr_0 = 9.9418e-04
Validation auc = 0.716771
Epoch 8317
Loss = 4.4500e-02, PNorm = 495.2526, GNorm = 1.3066, lr_0 = 9.9418e-04
Validation auc = 0.720096
Epoch 8318
Loss = 7.2395e-02, PNorm = 495.2830, GNorm = 3.4476, lr_0 = 9.9418e-04
Validation auc = 0.721691
Epoch 8319
Loss = 5.3630e-04, PNorm = 495.3079, GNorm = 0.0268, lr_0 = 9.9418e-04
Loss = 2.8029e-02, PNorm = 495.3356, GNorm = 0.2277, lr_0 = 9.9418e-04
Validation auc = 0.721552
Epoch 8320
Loss = 8.9462e-03, PNorm = 495.3615, GNorm = 0.0378, lr_0 = 9.9418e-04
Validation auc = 0.722877
Epoch 8321
Loss = 2.0805e-02, PNorm = 495.3792, GNorm = 1.7121, lr_0 = 9.9418e-04
Validation auc = 0.721861
Epoch 8322
Loss = 2.7856e-02, PNorm = 495.3972, GNorm = 0.2551, lr_0 = 9.9417e-04
Validation auc = 0.720573
Epoch 8323
Loss = 1.8621e-02, PNorm = 495.4176, GNorm = 0.0740, lr_0 = 9.9417e-04
Validation auc = 0.719499
Epoch 8324
Loss = 3.1328e-02, PNorm = 495.4394, GNorm = 0.0543, lr_0 = 9.9417e-04
Validation auc = 0.721907
Epoch 8325
Loss = 1.6701e-02, PNorm = 495.4631, GNorm = 0.0519, lr_0 = 9.9417e-04
Validation auc = 0.724869
Epoch 8326
Loss = 2.2960e-02, PNorm = 495.4848, GNorm = 2.3846, lr_0 = 9.9417e-04
Validation auc = 0.730215
Epoch 8327
Loss = 5.4544e-03, PNorm = 495.5068, GNorm = 0.1584, lr_0 = 9.9417e-04
Validation auc = 0.730867
Epoch 8328
Loss = 5.2496e-02, PNorm = 495.5227, GNorm = 3.2916, lr_0 = 9.9417e-04
Validation auc = 0.729382
Epoch 8329
Loss = 6.5134e-03, PNorm = 495.5512, GNorm = 1.0138, lr_0 = 9.9417e-04
Loss = 1.4607e-02, PNorm = 495.5744, GNorm = 0.3917, lr_0 = 9.9417e-04
Validation auc = 0.725388
Epoch 8330
Loss = 3.5632e-02, PNorm = 495.5932, GNorm = 1.4057, lr_0 = 9.9417e-04
Validation auc = 0.727576
Epoch 8331
Loss = 2.3678e-02, PNorm = 495.6154, GNorm = 0.3134, lr_0 = 9.9417e-04
Validation auc = 0.732094
Epoch 8332
Loss = 7.5956e-03, PNorm = 495.6350, GNorm = 0.0729, lr_0 = 9.9417e-04
Validation auc = 0.734540
Epoch 8333
Loss = 2.5649e-02, PNorm = 495.6480, GNorm = 0.7363, lr_0 = 9.9417e-04
Validation auc = 0.732139
Epoch 8334
Loss = 3.3667e-03, PNorm = 495.6615, GNorm = 0.0730, lr_0 = 9.9417e-04
Validation auc = 0.733681
Epoch 8335
Loss = 1.5213e-02, PNorm = 495.6743, GNorm = 0.4950, lr_0 = 9.9416e-04
Validation auc = 0.730754
Epoch 8336
Loss = 5.0799e-02, PNorm = 495.7022, GNorm = 0.3214, lr_0 = 9.9416e-04
Validation auc = 0.727664
Epoch 8337
Loss = 4.2167e-02, PNorm = 495.7456, GNorm = 2.6189, lr_0 = 9.9416e-04
Validation auc = 0.726142
Epoch 8338
Loss = 8.8990e-03, PNorm = 495.7836, GNorm = 0.1650, lr_0 = 9.9416e-04
Validation auc = 0.725531
Epoch 8339
Loss = 1.1019e-02, PNorm = 495.8239, GNorm = 0.6210, lr_0 = 9.9416e-04
Loss = 2.4786e-02, PNorm = 495.8577, GNorm = 0.0603, lr_0 = 9.9416e-04
Validation auc = 0.729336
Epoch 8340
Loss = 1.4488e-02, PNorm = 495.8826, GNorm = 0.7744, lr_0 = 9.9416e-04
Validation auc = 0.734259
Epoch 8341
Loss = 2.8522e-02, PNorm = 495.9076, GNorm = 2.5726, lr_0 = 9.9416e-04
Validation auc = 0.731527
Epoch 8342
Loss = 8.1420e-03, PNorm = 495.9305, GNorm = 0.8140, lr_0 = 9.9416e-04
Validation auc = 0.731857
Epoch 8343
Loss = 4.1774e-02, PNorm = 495.9530, GNorm = 0.1091, lr_0 = 9.9416e-04
Validation auc = 0.738015
Epoch 8344
Loss = 9.4928e-03, PNorm = 495.9768, GNorm = 0.1604, lr_0 = 9.9416e-04
Validation auc = 0.737891
Epoch 8345
Loss = 5.3870e-02, PNorm = 495.9951, GNorm = 2.4584, lr_0 = 9.9416e-04
Validation auc = 0.733165
Epoch 8346
Loss = 1.8319e-02, PNorm = 496.0194, GNorm = 0.2405, lr_0 = 9.9416e-04
Validation auc = 0.732233
Epoch 8347
Loss = 3.5169e-02, PNorm = 496.0455, GNorm = 0.3272, lr_0 = 9.9416e-04
Validation auc = 0.733322
Epoch 8348
Loss = 7.8323e-03, PNorm = 496.0817, GNorm = 0.5384, lr_0 = 9.9416e-04
Validation auc = 0.732463
Epoch 8349
Loss = 3.3799e-03, PNorm = 496.1096, GNorm = 0.1440, lr_0 = 9.9415e-04
Loss = 1.3175e-02, PNorm = 496.1336, GNorm = 0.1079, lr_0 = 9.9415e-04
Validation auc = 0.735158
Epoch 8350
Loss = 3.1735e-02, PNorm = 496.1511, GNorm = 4.4534, lr_0 = 9.9415e-04
Validation auc = 0.734055
Epoch 8351
Loss = 1.1193e-02, PNorm = 496.1696, GNorm = 0.0532, lr_0 = 9.9415e-04
Validation auc = 0.735458
Epoch 8352
Loss = 2.5222e-02, PNorm = 496.1864, GNorm = 1.6170, lr_0 = 9.9415e-04
Validation auc = 0.737932
Epoch 8353
Loss = 2.6541e-02, PNorm = 496.2090, GNorm = 1.5408, lr_0 = 9.9415e-04
Validation auc = 0.736992
Epoch 8354
Loss = 1.0107e-02, PNorm = 496.2307, GNorm = 0.1470, lr_0 = 9.9415e-04
Validation auc = 0.733999
Epoch 8355
Loss = 4.7088e-02, PNorm = 496.2533, GNorm = 0.0281, lr_0 = 9.9415e-04
Validation auc = 0.730916
Epoch 8356
Loss = 1.4533e-02, PNorm = 496.2761, GNorm = 0.4499, lr_0 = 9.9415e-04
Validation auc = 0.731188
Epoch 8357
Loss = 5.6341e-02, PNorm = 496.2936, GNorm = 0.2518, lr_0 = 9.9415e-04
Validation auc = 0.730461
Epoch 8358
Loss = 2.4514e-02, PNorm = 496.3115, GNorm = 0.3852, lr_0 = 9.9415e-04
Validation auc = 0.729320
Epoch 8359
Loss = 1.1018e-02, PNorm = 496.3295, GNorm = 0.4359, lr_0 = 9.9415e-04
Loss = 1.4081e-02, PNorm = 496.3459, GNorm = 0.2518, lr_0 = 9.9415e-04
Validation auc = 0.716598
Epoch 8360
Loss = 1.7881e-02, PNorm = 496.3637, GNorm = 0.0850, lr_0 = 9.9415e-04
Validation auc = 0.720050
Epoch 8361
Loss = 3.9872e-02, PNorm = 496.3842, GNorm = 1.4858, lr_0 = 9.9414e-04
Validation auc = 0.724617
Epoch 8362
Loss = 2.6495e-02, PNorm = 496.4064, GNorm = 0.7365, lr_0 = 9.9414e-04
Validation auc = 0.721354
Epoch 8363
Loss = 4.8212e-03, PNorm = 496.4227, GNorm = 0.5058, lr_0 = 9.9414e-04
Validation auc = 0.722920
Epoch 8364
Loss = 3.8831e-02, PNorm = 496.4363, GNorm = 0.1205, lr_0 = 9.9414e-04
Validation auc = 0.727957
Epoch 8365
Loss = 1.3847e-02, PNorm = 496.4543, GNorm = 1.1352, lr_0 = 9.9414e-04
Validation auc = 0.732503
Epoch 8366
Loss = 1.5938e-02, PNorm = 496.4769, GNorm = 1.4251, lr_0 = 9.9414e-04
Validation auc = 0.740431
Epoch 8367
Loss = 2.9172e-02, PNorm = 496.5008, GNorm = 1.1112, lr_0 = 9.9414e-04
Validation auc = 0.742865
Epoch 8368
Loss = 8.1684e-02, PNorm = 496.5279, GNorm = 2.4902, lr_0 = 9.9414e-04
Validation auc = 0.736852
Epoch 8369
Loss = 9.3068e-03, PNorm = 496.5523, GNorm = 0.3652, lr_0 = 9.9414e-04
Loss = 4.6367e-02, PNorm = 496.5789, GNorm = 2.3076, lr_0 = 9.9414e-04
Validation auc = 0.733604
Epoch 8370
Loss = 2.9639e-02, PNorm = 496.6073, GNorm = 2.0492, lr_0 = 9.9414e-04
Validation auc = 0.735550
Epoch 8371
Loss = 4.2288e-02, PNorm = 496.6295, GNorm = 0.1266, lr_0 = 9.9414e-04
Validation auc = 0.736900
Epoch 8372
Loss = 3.0902e-02, PNorm = 496.6524, GNorm = 0.0831, lr_0 = 9.9414e-04
Validation auc = 0.737376
Epoch 8373
Loss = 8.8136e-03, PNorm = 496.6823, GNorm = 0.0888, lr_0 = 9.9414e-04
Validation auc = 0.736156
Epoch 8374
Loss = 8.4989e-03, PNorm = 496.7058, GNorm = 0.0246, lr_0 = 9.9414e-04
Validation auc = 0.736990
Epoch 8375
Loss = 1.1457e-02, PNorm = 496.7234, GNorm = 0.0575, lr_0 = 9.9413e-04
Validation auc = 0.737983
Epoch 8376
Loss = 2.1424e-02, PNorm = 496.7481, GNorm = 2.6326, lr_0 = 9.9413e-04
Validation auc = 0.741074
Epoch 8377
Loss = 4.5250e-02, PNorm = 496.7805, GNorm = 2.9502, lr_0 = 9.9413e-04
Validation auc = 0.744608
Epoch 8378
Loss = 4.3446e-02, PNorm = 496.8165, GNorm = 1.1300, lr_0 = 9.9413e-04
Validation auc = 0.744980
Epoch 8379
Loss = 1.7458e-02, PNorm = 496.8537, GNorm = 0.7661, lr_0 = 9.9413e-04
Loss = 3.7844e-02, PNorm = 496.8898, GNorm = 0.6739, lr_0 = 9.9413e-04
Validation auc = 0.742472
Epoch 8380
Loss = 4.3690e-02, PNorm = 496.9243, GNorm = 2.5161, lr_0 = 9.9413e-04
Validation auc = 0.735670
Epoch 8381
Loss = 1.9945e-02, PNorm = 496.9550, GNorm = 2.7059, lr_0 = 9.9413e-04
Validation auc = 0.731421
Epoch 8382
Loss = 4.0776e-02, PNorm = 496.9828, GNorm = 2.1752, lr_0 = 9.9413e-04
Validation auc = 0.730269
Epoch 8383
Loss = 5.0854e-02, PNorm = 497.0167, GNorm = 0.3830, lr_0 = 9.9413e-04
Validation auc = 0.733700
Epoch 8384
Loss = 2.5704e-02, PNorm = 497.0510, GNorm = 0.8136, lr_0 = 9.9413e-04
Validation auc = 0.733194
Epoch 8385
Loss = 6.5105e-02, PNorm = 497.0823, GNorm = 2.9103, lr_0 = 9.9413e-04
Validation auc = 0.728856
Epoch 8386
Loss = 2.3838e-02, PNorm = 497.1165, GNorm = 0.2918, lr_0 = 9.9413e-04
Validation auc = 0.731026
Epoch 8387
Loss = 7.2374e-02, PNorm = 497.1448, GNorm = 0.3557, lr_0 = 9.9413e-04
Validation auc = 0.738348
Epoch 8388
Loss = 2.3737e-02, PNorm = 497.1835, GNorm = 1.6756, lr_0 = 9.9413e-04
Validation auc = 0.733868
Epoch 8389
Loss = 1.7537e-02, PNorm = 497.2235, GNorm = 1.0383, lr_0 = 9.9412e-04
Loss = 2.7689e-02, PNorm = 497.2594, GNorm = 0.4930, lr_0 = 9.9412e-04
Validation auc = 0.730454
Epoch 8390
Loss = 3.0966e-02, PNorm = 497.2933, GNorm = 0.2141, lr_0 = 9.9412e-04
Validation auc = 0.734550
Epoch 8391
Loss = 1.2259e-02, PNorm = 497.3286, GNorm = 0.1623, lr_0 = 9.9412e-04
Validation auc = 0.726436
Epoch 8392
Loss = 2.8772e-02, PNorm = 497.3579, GNorm = 2.7742, lr_0 = 9.9412e-04
Validation auc = 0.718767
Epoch 8393
Loss = 1.2359e-02, PNorm = 497.3887, GNorm = 0.2472, lr_0 = 9.9412e-04
Validation auc = 0.718189
Epoch 8394
Loss = 4.0985e-02, PNorm = 497.4164, GNorm = 1.4567, lr_0 = 9.9412e-04
Validation auc = 0.723948
Epoch 8395
Loss = 2.3745e-02, PNorm = 497.4458, GNorm = 0.1193, lr_0 = 9.9412e-04
Validation auc = 0.740682
Epoch 8396
Loss = 2.7812e-03, PNorm = 497.4757, GNorm = 0.0495, lr_0 = 9.9412e-04
Validation auc = 0.743665
Epoch 8397
Loss = 4.7548e-02, PNorm = 497.5021, GNorm = 0.0501, lr_0 = 9.9412e-04
Validation auc = 0.733736
Epoch 8398
Loss = 2.5902e-03, PNorm = 497.5354, GNorm = 0.1476, lr_0 = 9.9412e-04
Validation auc = 0.732648
Epoch 8399
Loss = 3.8725e-03, PNorm = 497.5628, GNorm = 0.1412, lr_0 = 9.9412e-04
Loss = 3.6839e-02, PNorm = 497.5845, GNorm = 0.9236, lr_0 = 9.9412e-04
Validation auc = 0.738697
Epoch 8400
Loss = 4.9108e-02, PNorm = 497.6078, GNorm = 2.9781, lr_0 = 9.9412e-04
Validation auc = 0.737888
Epoch 8401
Loss = 3.4638e-02, PNorm = 497.6469, GNorm = 0.1201, lr_0 = 9.9411e-04
Validation auc = 0.733701
Epoch 8402
Loss = 4.3613e-02, PNorm = 497.6883, GNorm = 1.0509, lr_0 = 9.9411e-04
Validation auc = 0.730526
Epoch 8403
Loss = 1.5797e-02, PNorm = 497.7296, GNorm = 0.1023, lr_0 = 9.9411e-04
Validation auc = 0.725660
Epoch 8404
Loss = 3.8945e-02, PNorm = 497.7575, GNorm = 1.0134, lr_0 = 9.9411e-04
Validation auc = 0.718513
Epoch 8405
Loss = 2.3585e-02, PNorm = 497.7832, GNorm = 0.1703, lr_0 = 9.9411e-04
Validation auc = 0.723463
Epoch 8406
Loss = 3.6407e-02, PNorm = 497.8072, GNorm = 1.9856, lr_0 = 9.9411e-04
Validation auc = 0.723968
Epoch 8407
Loss = 6.9543e-03, PNorm = 497.8319, GNorm = 0.5798, lr_0 = 9.9411e-04
Validation auc = 0.726052
Epoch 8408
Loss = 6.7485e-03, PNorm = 497.8492, GNorm = 0.9918, lr_0 = 9.9411e-04
Validation auc = 0.728151
Epoch 8409
Loss = 2.5406e-02, PNorm = 497.8667, GNorm = 1.5762, lr_0 = 9.9411e-04
Loss = 2.8726e-02, PNorm = 497.8893, GNorm = 0.0642, lr_0 = 9.9411e-04
Validation auc = 0.730724
Epoch 8410
Loss = 7.5720e-03, PNorm = 497.9114, GNorm = 0.0370, lr_0 = 9.9411e-04
Validation auc = 0.732480
Epoch 8411
Loss = 1.7142e-02, PNorm = 497.9315, GNorm = 3.4156, lr_0 = 9.9411e-04
Validation auc = 0.732729
Epoch 8412
Loss = 1.2775e-02, PNorm = 497.9551, GNorm = 0.0519, lr_0 = 9.9411e-04
Validation auc = 0.736052
Epoch 8413
Loss = 3.6099e-02, PNorm = 497.9741, GNorm = 8.1239, lr_0 = 9.9411e-04
Validation auc = 0.738921
Epoch 8414
Loss = 6.5016e-03, PNorm = 498.0006, GNorm = 0.0038, lr_0 = 9.9411e-04
Validation auc = 0.735201
Epoch 8415
Loss = 9.0959e-02, PNorm = 498.0319, GNorm = 0.1490, lr_0 = 9.9410e-04
Validation auc = 0.730003
Epoch 8416
Loss = 1.1688e-01, PNorm = 498.0913, GNorm = 0.1665, lr_0 = 9.9410e-04
Validation auc = 0.737539
Epoch 8417
Loss = 2.3180e-02, PNorm = 498.1573, GNorm = 0.1722, lr_0 = 9.9410e-04
Validation auc = 0.739381
Epoch 8418
Loss = 3.4669e-02, PNorm = 498.2013, GNorm = 0.2739, lr_0 = 9.9410e-04
Validation auc = 0.743211
Epoch 8419
Loss = 8.2142e-03, PNorm = 498.2425, GNorm = 0.2772, lr_0 = 9.9410e-04
Loss = 3.0861e-02, PNorm = 498.2802, GNorm = 0.0700, lr_0 = 9.9410e-04
Validation auc = 0.742470
Epoch 8420
Loss = 3.2878e-02, PNorm = 498.3117, GNorm = 0.1729, lr_0 = 9.9410e-04
Validation auc = 0.737775
Epoch 8421
Loss = 3.9080e-02, PNorm = 498.3464, GNorm = 0.1003, lr_0 = 9.9410e-04
Validation auc = 0.737532
Epoch 8422
Loss = 1.6620e-02, PNorm = 498.3787, GNorm = 0.1587, lr_0 = 9.9410e-04
Validation auc = 0.733479
Epoch 8423
Loss = 3.6612e-02, PNorm = 498.4043, GNorm = 0.1006, lr_0 = 9.9410e-04
Validation auc = 0.730973
Epoch 8424
Loss = 7.6969e-03, PNorm = 498.4299, GNorm = 0.1854, lr_0 = 9.9410e-04
Validation auc = 0.729043
Epoch 8425
Loss = 9.5363e-03, PNorm = 498.4517, GNorm = 0.2243, lr_0 = 9.9410e-04
Validation auc = 0.733759
Epoch 8426
Loss = 1.0644e-02, PNorm = 498.4811, GNorm = 0.0435, lr_0 = 9.9410e-04
Validation auc = 0.731755
Epoch 8427
Loss = 3.8702e-02, PNorm = 498.5117, GNorm = 2.5581, lr_0 = 9.9410e-04
Validation auc = 0.730513
Epoch 8428
Loss = 1.4690e-03, PNorm = 498.5433, GNorm = 0.0611, lr_0 = 9.9409e-04
Validation auc = 0.727529
Epoch 8429
Loss = 1.9973e-02, PNorm = 498.5787, GNorm = 0.9124, lr_0 = 9.9409e-04
Loss = 1.8689e-02, PNorm = 498.6183, GNorm = 0.7651, lr_0 = 9.9409e-04
Validation auc = 0.720399
Epoch 8430
Loss = 2.1744e-02, PNorm = 498.6448, GNorm = 0.2737, lr_0 = 9.9409e-04
Validation auc = 0.719023
Epoch 8431
Loss = 1.5212e-02, PNorm = 498.6695, GNorm = 0.0408, lr_0 = 9.9409e-04
Validation auc = 0.724196
Epoch 8432
Loss = 9.5780e-03, PNorm = 498.6946, GNorm = 0.0417, lr_0 = 9.9409e-04
Validation auc = 0.720097
Epoch 8433
Loss = 3.8999e-02, PNorm = 498.7151, GNorm = 0.2515, lr_0 = 9.9409e-04
Validation auc = 0.718435
Epoch 8434
Loss = 1.8477e-02, PNorm = 498.7475, GNorm = 0.8950, lr_0 = 9.9409e-04
Validation auc = 0.717487
Epoch 8435
Loss = 2.8219e-02, PNorm = 498.7823, GNorm = 0.6998, lr_0 = 9.9409e-04
Validation auc = 0.718431
Epoch 8436
Loss = 1.6178e-02, PNorm = 498.8189, GNorm = 0.8262, lr_0 = 9.9409e-04
Validation auc = 0.715829
Epoch 8437
Loss = 1.2078e-02, PNorm = 498.8515, GNorm = 0.5968, lr_0 = 9.9409e-04
Validation auc = 0.720581
Epoch 8438
Loss = 5.7195e-02, PNorm = 498.8845, GNorm = 3.6279, lr_0 = 9.9409e-04
Validation auc = 0.716696
Epoch 8439
Loss = 1.3876e-01, PNorm = 498.9287, GNorm = 2.7159, lr_0 = 9.9409e-04
Loss = 3.3309e-02, PNorm = 498.9740, GNorm = 2.7449, lr_0 = 9.9409e-04
Validation auc = 0.707282
Epoch 8440
Loss = 2.7043e-02, PNorm = 499.0082, GNorm = 0.5381, lr_0 = 9.9409e-04
Validation auc = 0.713096
Epoch 8441
Loss = 2.2369e-02, PNorm = 499.0398, GNorm = 0.3332, lr_0 = 9.9408e-04
Validation auc = 0.718704
Epoch 8442
Loss = 2.4041e-02, PNorm = 499.0683, GNorm = 0.1333, lr_0 = 9.9408e-04
Validation auc = 0.724358
Epoch 8443
Loss = 6.1191e-03, PNorm = 499.0964, GNorm = 0.0183, lr_0 = 9.9408e-04
Validation auc = 0.717743
Epoch 8444
Loss = 2.7269e-02, PNorm = 499.1185, GNorm = 0.0375, lr_0 = 9.9408e-04
Validation auc = 0.712695
Epoch 8445
Loss = 2.4429e-02, PNorm = 499.1430, GNorm = 0.5924, lr_0 = 9.9408e-04
Validation auc = 0.711327
Epoch 8446
Loss = 9.9908e-03, PNorm = 499.1701, GNorm = 1.2880, lr_0 = 9.9408e-04
Validation auc = 0.709655
Epoch 8447
Loss = 5.3594e-02, PNorm = 499.1961, GNorm = 0.0902, lr_0 = 9.9408e-04
Validation auc = 0.698233
Epoch 8448
Loss = 8.8394e-02, PNorm = 499.2245, GNorm = 0.6911, lr_0 = 9.9408e-04
Validation auc = 0.703184
Epoch 8449
Loss = 1.0024e-02, PNorm = 499.2592, GNorm = 0.8080, lr_0 = 9.9408e-04
Loss = 4.1107e-02, PNorm = 499.2917, GNorm = 0.1087, lr_0 = 9.9408e-04
Validation auc = 0.711925
Epoch 8450
Loss = 1.6238e-02, PNorm = 499.3188, GNorm = 0.4943, lr_0 = 9.9408e-04
Validation auc = 0.715874
Epoch 8451
Loss = 1.2591e-02, PNorm = 499.3396, GNorm = 0.1539, lr_0 = 9.9408e-04
Validation auc = 0.715831
Epoch 8452
Loss = 2.7185e-02, PNorm = 499.3567, GNorm = 0.0329, lr_0 = 9.9408e-04
Validation auc = 0.714038
Epoch 8453
Loss = 2.3537e-02, PNorm = 499.3829, GNorm = 0.1502, lr_0 = 9.9408e-04
Validation auc = 0.705324
Epoch 8454
Loss = 1.8160e-02, PNorm = 499.4085, GNorm = 1.2589, lr_0 = 9.9408e-04
Validation auc = 0.704946
Epoch 8455
Loss = 2.6140e-02, PNorm = 499.4296, GNorm = 0.2987, lr_0 = 9.9407e-04
Validation auc = 0.708463
Epoch 8456
Loss = 4.3987e-02, PNorm = 499.4537, GNorm = 0.1717, lr_0 = 9.9407e-04
Validation auc = 0.709938
Epoch 8457
Loss = 1.1249e-01, PNorm = 499.4776, GNorm = 0.1678, lr_0 = 9.9407e-04
Validation auc = 0.706393
Epoch 8458
Loss = 5.4307e-03, PNorm = 499.5013, GNorm = 0.5660, lr_0 = 9.9407e-04
Validation auc = 0.702565
Epoch 8459
Loss = 1.4231e-02, PNorm = 499.5189, GNorm = 0.5199, lr_0 = 9.9407e-04
Loss = 3.5002e-02, PNorm = 499.5339, GNorm = 1.2104, lr_0 = 9.9407e-04
Validation auc = 0.701762
Epoch 8460
Loss = 2.8675e-02, PNorm = 499.5546, GNorm = 1.4357, lr_0 = 9.9407e-04
Validation auc = 0.702314
Epoch 8461
Loss = 5.6298e-02, PNorm = 499.5772, GNorm = 2.2748, lr_0 = 9.9407e-04
Validation auc = 0.701274
Epoch 8462
Loss = 2.8290e-02, PNorm = 499.6049, GNorm = 1.0745, lr_0 = 9.9407e-04
Validation auc = 0.694029
Epoch 8463
Loss = 3.3070e-02, PNorm = 499.6368, GNorm = 4.4576, lr_0 = 9.9407e-04
Validation auc = 0.695129
Epoch 8464
Loss = 1.4330e-02, PNorm = 499.6695, GNorm = 0.3312, lr_0 = 9.9407e-04
Validation auc = 0.691052
Epoch 8465
Loss = 2.5388e-02, PNorm = 499.7044, GNorm = 0.1652, lr_0 = 9.9407e-04
Validation auc = 0.695220
Epoch 8466
Loss = 9.2464e-02, PNorm = 499.7372, GNorm = 1.5646, lr_0 = 9.9407e-04
Validation auc = 0.696606
Epoch 8467
Loss = 3.9993e-03, PNorm = 499.7725, GNorm = 0.1103, lr_0 = 9.9407e-04
Validation auc = 0.691988
Epoch 8468
Loss = 1.9576e-02, PNorm = 499.8107, GNorm = 0.6645, lr_0 = 9.9406e-04
Validation auc = 0.693160
Epoch 8469
Loss = 4.1410e-02, PNorm = 499.8503, GNorm = 1.3358, lr_0 = 9.9406e-04
Loss = 2.0516e-02, PNorm = 499.8863, GNorm = 1.3079, lr_0 = 9.9406e-04
Validation auc = 0.699854
Epoch 8470
Loss = 2.3660e-02, PNorm = 499.9197, GNorm = 0.1316, lr_0 = 9.9406e-04
Validation auc = 0.708146
Epoch 8471
Loss = 1.2641e-02, PNorm = 499.9484, GNorm = 0.2034, lr_0 = 9.9406e-04
Validation auc = 0.713015
Epoch 8472
Loss = 6.4646e-03, PNorm = 499.9696, GNorm = 0.5728, lr_0 = 9.9406e-04
Validation auc = 0.715727
Epoch 8473
Loss = 3.8739e-02, PNorm = 499.9909, GNorm = 0.1235, lr_0 = 9.9406e-04
Validation auc = 0.712590
Epoch 8474
Loss = 1.8020e-02, PNorm = 500.0144, GNorm = 0.1963, lr_0 = 9.9406e-04
Validation auc = 0.712003
Epoch 8475
Loss = 1.2929e-02, PNorm = 500.0405, GNorm = 0.1787, lr_0 = 9.9406e-04
Validation auc = 0.710272
Epoch 8476
Loss = 1.6862e-02, PNorm = 500.0601, GNorm = 0.5772, lr_0 = 9.9406e-04
Validation auc = 0.706007
Epoch 8477
Loss = 2.5668e-02, PNorm = 500.0775, GNorm = 0.0268, lr_0 = 9.9406e-04
Validation auc = 0.701047
Epoch 8478
Loss = 1.2230e-02, PNorm = 500.0982, GNorm = 1.8513, lr_0 = 9.9406e-04
Validation auc = 0.712889
Epoch 8479
Loss = 1.1323e-02, PNorm = 500.1260, GNorm = 0.7547, lr_0 = 9.9406e-04
Loss = 8.8528e-03, PNorm = 500.1521, GNorm = 1.1967, lr_0 = 9.9406e-04
Validation auc = 0.714526
Epoch 8480
Loss = 6.1941e-02, PNorm = 500.1729, GNorm = 2.6203, lr_0 = 9.9406e-04
Validation auc = 0.714012
Epoch 8481
Loss = 2.4979e-02, PNorm = 500.1994, GNorm = 1.1596, lr_0 = 9.9405e-04
Validation auc = 0.708041
Epoch 8482
Loss = 2.8863e-02, PNorm = 500.2242, GNorm = 0.0740, lr_0 = 9.9405e-04
Validation auc = 0.714588
Epoch 8483
Loss = 3.1310e-02, PNorm = 500.2516, GNorm = 0.9206, lr_0 = 9.9405e-04
Validation auc = 0.709924
Epoch 8484
Loss = 8.4470e-02, PNorm = 500.2833, GNorm = 1.5836, lr_0 = 9.9405e-04
Validation auc = 0.723670
Epoch 8485
Loss = 3.9445e-02, PNorm = 500.3302, GNorm = 0.3099, lr_0 = 9.9405e-04
Validation auc = 0.719329
Epoch 8486
Loss = 2.2824e-02, PNorm = 500.3665, GNorm = 0.2400, lr_0 = 9.9405e-04
Validation auc = 0.712124
Epoch 8487
Loss = 2.0745e-02, PNorm = 500.4016, GNorm = 0.8096, lr_0 = 9.9405e-04
Validation auc = 0.716688
Epoch 8488
Loss = 1.7209e-02, PNorm = 500.4356, GNorm = 1.2385, lr_0 = 9.9405e-04
Validation auc = 0.723479
Epoch 8489
Loss = 7.7430e-03, PNorm = 500.4608, GNorm = 0.7138, lr_0 = 9.9405e-04
Loss = 4.3451e-02, PNorm = 500.4833, GNorm = 3.7113, lr_0 = 9.9405e-04
Validation auc = 0.726975
Epoch 8490
Loss = 3.8698e-02, PNorm = 500.5135, GNorm = 1.8043, lr_0 = 9.9405e-04
Validation auc = 0.717449
Epoch 8491
Loss = 4.7257e-02, PNorm = 500.5447, GNorm = 0.1651, lr_0 = 9.9405e-04
Validation auc = 0.722372
Epoch 8492
Loss = 2.0471e-02, PNorm = 500.5715, GNorm = 0.4017, lr_0 = 9.9405e-04
Validation auc = 0.719966
Epoch 8493
Loss = 2.1754e-02, PNorm = 500.5958, GNorm = 0.0985, lr_0 = 9.9405e-04
Validation auc = 0.716982
Epoch 8494
Loss = 3.1416e-02, PNorm = 500.6271, GNorm = 0.0211, lr_0 = 9.9404e-04
Validation auc = 0.723537
Epoch 8495
Loss = 7.0103e-02, PNorm = 500.6629, GNorm = 0.0239, lr_0 = 9.9404e-04
Validation auc = 0.723640
Epoch 8496
Loss = 1.6214e-01, PNorm = 500.7012, GNorm = 0.9316, lr_0 = 9.9404e-04
Validation auc = 0.726012
Epoch 8497
Loss = 1.7929e-02, PNorm = 500.7387, GNorm = 0.6602, lr_0 = 9.9404e-04
Validation auc = 0.723956
Epoch 8498
Loss = 3.5302e-03, PNorm = 500.7669, GNorm = 0.0795, lr_0 = 9.9404e-04
Validation auc = 0.725229
Epoch 8499
Loss = 5.7206e-02, PNorm = 500.7881, GNorm = 1.4302, lr_0 = 9.9404e-04
Loss = 3.0002e-02, PNorm = 500.8098, GNorm = 0.5538, lr_0 = 9.9404e-04
Validation auc = 0.721914
Epoch 8500
Loss = 3.5177e-02, PNorm = 500.8358, GNorm = 0.6787, lr_0 = 9.9404e-04
Validation auc = 0.729027
Epoch 8501
Loss = 3.4653e-02, PNorm = 500.8644, GNorm = 0.0215, lr_0 = 9.9404e-04
Validation auc = 0.732070
Epoch 8502
Loss = 1.7715e-02, PNorm = 500.8861, GNorm = 1.0345, lr_0 = 9.9404e-04
Validation auc = 0.732758
Epoch 8503
Loss = 1.4610e-02, PNorm = 500.9021, GNorm = 1.0834, lr_0 = 9.9404e-04
Validation auc = 0.728180
Epoch 8504
Loss = 7.4028e-03, PNorm = 500.9217, GNorm = 0.1757, lr_0 = 9.9404e-04
Validation auc = 0.720148
Epoch 8505
Loss = 1.1335e-02, PNorm = 500.9391, GNorm = 1.2252, lr_0 = 9.9404e-04
Validation auc = 0.719037
Epoch 8506
Loss = 7.7899e-02, PNorm = 500.9533, GNorm = 0.7930, lr_0 = 9.9404e-04
Validation auc = 0.719614
Epoch 8507
Loss = 1.0907e-02, PNorm = 500.9698, GNorm = 0.7707, lr_0 = 9.9404e-04
Validation auc = 0.716508
Epoch 8508
Loss = 1.3467e-02, PNorm = 500.9818, GNorm = 0.0728, lr_0 = 9.9403e-04
Validation auc = 0.715360
Epoch 8509
Loss = 2.4857e-03, PNorm = 501.0027, GNorm = 0.1057, lr_0 = 9.9403e-04
Loss = 1.3674e-02, PNorm = 501.0232, GNorm = 0.0568, lr_0 = 9.9403e-04
Validation auc = 0.715560
Epoch 8510
Loss = 4.4670e-02, PNorm = 501.0446, GNorm = 2.2452, lr_0 = 9.9403e-04
Validation auc = 0.714680
Epoch 8511
Loss = 1.4724e-02, PNorm = 501.0710, GNorm = 1.6753, lr_0 = 9.9403e-04
Validation auc = 0.711081
Epoch 8512
Loss = 4.6713e-02, PNorm = 501.0919, GNorm = 0.1168, lr_0 = 9.9403e-04
Validation auc = 0.714804
Epoch 8513
Loss = 2.5355e-02, PNorm = 501.1121, GNorm = 1.2993, lr_0 = 9.9403e-04
Validation auc = 0.712018
Epoch 8514
Loss = 1.0656e-02, PNorm = 501.1335, GNorm = 0.2229, lr_0 = 9.9403e-04
Validation auc = 0.712329
Epoch 8515
Loss = 7.4644e-03, PNorm = 501.1498, GNorm = 0.0829, lr_0 = 9.9403e-04
Validation auc = 0.715141
Epoch 8516
Loss = 5.1410e-02, PNorm = 501.1740, GNorm = 1.8115, lr_0 = 9.9403e-04
Validation auc = 0.719429
Epoch 8517
Loss = 9.6419e-03, PNorm = 501.2005, GNorm = 1.3103, lr_0 = 9.9403e-04
Validation auc = 0.725893
Epoch 8518
Loss = 1.0463e-01, PNorm = 501.2233, GNorm = 0.0122, lr_0 = 9.9403e-04
Validation auc = 0.723365
Epoch 8519
Loss = 7.7611e-02, PNorm = 501.2511, GNorm = 1.7977, lr_0 = 9.9403e-04
Loss = 2.5434e-02, PNorm = 501.2824, GNorm = 0.6789, lr_0 = 9.9403e-04
Validation auc = 0.724222
Epoch 8520
Loss = 6.5542e-02, PNorm = 501.3133, GNorm = 0.3689, lr_0 = 9.9403e-04
Validation auc = 0.719803
Epoch 8521
Loss = 4.1942e-02, PNorm = 501.3482, GNorm = 0.0597, lr_0 = 9.9402e-04
Validation auc = 0.715493
Epoch 8522
Loss = 5.0964e-03, PNorm = 501.3802, GNorm = 0.1360, lr_0 = 9.9402e-04
Validation auc = 0.722693
Epoch 8523
Loss = 2.2892e-02, PNorm = 501.4054, GNorm = 0.1523, lr_0 = 9.9402e-04
Validation auc = 0.727125
Epoch 8524
Loss = 4.0890e-02, PNorm = 501.4294, GNorm = 1.9245, lr_0 = 9.9402e-04
Validation auc = 0.719033
Epoch 8525
Loss = 1.2407e-02, PNorm = 501.4526, GNorm = 1.0595, lr_0 = 9.9402e-04
Validation auc = 0.714687
Epoch 8526
Loss = 1.7733e-02, PNorm = 501.4745, GNorm = 0.5183, lr_0 = 9.9402e-04
Validation auc = 0.716434
Epoch 8527
Loss = 3.2634e-02, PNorm = 501.5030, GNorm = 6.2369, lr_0 = 9.9402e-04
Validation auc = 0.724041
Epoch 8528
Loss = 3.5540e-03, PNorm = 501.5284, GNorm = 0.0418, lr_0 = 9.9402e-04
Validation auc = 0.723620
Epoch 8529
Loss = 5.7553e-03, PNorm = 501.5487, GNorm = 0.2342, lr_0 = 9.9402e-04
Loss = 9.3737e-02, PNorm = 501.5749, GNorm = 0.1028, lr_0 = 9.9402e-04
Validation auc = 0.719517
Epoch 8530
Loss = 2.9285e-02, PNorm = 501.6159, GNorm = 0.4108, lr_0 = 9.9402e-04
Validation auc = 0.720503
Epoch 8531
Loss = 1.9116e-02, PNorm = 501.6506, GNorm = 0.2872, lr_0 = 9.9402e-04
Validation auc = 0.724206
Epoch 8532
Loss = 2.6898e-02, PNorm = 501.6768, GNorm = 1.9440, lr_0 = 9.9402e-04
Validation auc = 0.726291
Epoch 8533
Loss = 1.1195e-02, PNorm = 501.6985, GNorm = 1.4802, lr_0 = 9.9402e-04
Validation auc = 0.727769
Epoch 8534
Loss = 2.6981e-02, PNorm = 501.7252, GNorm = 1.2203, lr_0 = 9.9401e-04
Validation auc = 0.729293
Epoch 8535
Loss = 1.5751e-02, PNorm = 501.7519, GNorm = 1.5747, lr_0 = 9.9401e-04
Validation auc = 0.722563
Epoch 8536
Loss = 3.3331e-02, PNorm = 501.7734, GNorm = 1.8623, lr_0 = 9.9401e-04
Validation auc = 0.723253
Epoch 8537
Loss = 4.6268e-02, PNorm = 501.7943, GNorm = 0.2786, lr_0 = 9.9401e-04
Validation auc = 0.729174
Epoch 8538
Loss = 3.8845e-02, PNorm = 501.8179, GNorm = 2.9324, lr_0 = 9.9401e-04
Validation auc = 0.733124
Epoch 8539
Loss = 4.7556e-03, PNorm = 501.8457, GNorm = 0.1771, lr_0 = 9.9401e-04
Loss = 1.6364e-02, PNorm = 501.8668, GNorm = 0.0806, lr_0 = 9.9401e-04
Validation auc = 0.732638
Epoch 8540
Loss = 3.1502e-02, PNorm = 501.8900, GNorm = 0.2976, lr_0 = 9.9401e-04
Validation auc = 0.729572
Epoch 8541
Loss = 2.6685e-02, PNorm = 501.9214, GNorm = 2.2187, lr_0 = 9.9401e-04
Validation auc = 0.717764
Epoch 8542
Loss = 2.9194e-02, PNorm = 501.9528, GNorm = 1.1594, lr_0 = 9.9401e-04
Validation auc = 0.708023
Epoch 8543
Loss = 3.8007e-02, PNorm = 501.9868, GNorm = 1.7031, lr_0 = 9.9401e-04
Validation auc = 0.709123
Epoch 8544
Loss = 2.3029e-02, PNorm = 502.0300, GNorm = 0.1167, lr_0 = 9.9401e-04
Validation auc = 0.715239
Epoch 8545
Loss = 9.1515e-02, PNorm = 502.0636, GNorm = 0.7021, lr_0 = 9.9401e-04
Validation auc = 0.714825
Epoch 8546
Loss = 2.2980e-02, PNorm = 502.0951, GNorm = 0.7530, lr_0 = 9.9401e-04
Validation auc = 0.717392
Epoch 8547
Loss = 1.3776e-02, PNorm = 502.1266, GNorm = 0.7245, lr_0 = 9.9401e-04
Validation auc = 0.718096
Epoch 8548
Loss = 4.6003e-02, PNorm = 502.1518, GNorm = 0.0637, lr_0 = 9.9400e-04
Validation auc = 0.723409
Epoch 8549
Loss = 1.1232e-02, PNorm = 502.1734, GNorm = 0.5851, lr_0 = 9.9400e-04
Loss = 2.2810e-02, PNorm = 502.1945, GNorm = 0.0776, lr_0 = 9.9400e-04
Validation auc = 0.723047
Epoch 8550
Loss = 3.4139e-02, PNorm = 502.2173, GNorm = 0.0830, lr_0 = 9.9400e-04
Validation auc = 0.718494
Epoch 8551
Loss = 9.4409e-03, PNorm = 502.2353, GNorm = 0.0739, lr_0 = 9.9400e-04
Validation auc = 0.714482
Epoch 8552
Loss = 1.6566e-02, PNorm = 502.2491, GNorm = 0.0554, lr_0 = 9.9400e-04
Validation auc = 0.711759
Epoch 8553
Loss = 3.8088e-02, PNorm = 502.2692, GNorm = 1.5896, lr_0 = 9.9400e-04
Validation auc = 0.719145
Epoch 8554
Loss = 1.3809e-01, PNorm = 502.2948, GNorm = 1.6488, lr_0 = 9.9400e-04
Validation auc = 0.729250
Epoch 8555
Loss = 1.5012e-02, PNorm = 502.3271, GNorm = 0.2141, lr_0 = 9.9400e-04
Validation auc = 0.728546
Epoch 8556
Loss = 8.8138e-03, PNorm = 502.3586, GNorm = 0.3564, lr_0 = 9.9400e-04
Validation auc = 0.726307
Epoch 8557
Loss = 5.3051e-02, PNorm = 502.3812, GNorm = 0.2797, lr_0 = 9.9400e-04
Validation auc = 0.714693
Epoch 8558
Loss = 3.6854e-02, PNorm = 502.4051, GNorm = 1.9513, lr_0 = 9.9400e-04
Validation auc = 0.714541
Epoch 8559
Loss = 6.4193e-02, PNorm = 502.4245, GNorm = 1.3529, lr_0 = 9.9400e-04
Loss = 2.3783e-02, PNorm = 502.4457, GNorm = 0.0250, lr_0 = 9.9400e-04
Validation auc = 0.714853
Epoch 8560
Loss = 1.8043e-02, PNorm = 502.4668, GNorm = 0.1342, lr_0 = 9.9400e-04
Validation auc = 0.716854
Epoch 8561
Loss = 1.1400e-02, PNorm = 502.4913, GNorm = 0.1464, lr_0 = 9.9399e-04
Validation auc = 0.715457
Epoch 8562
Loss = 3.9189e-03, PNorm = 502.5117, GNorm = 0.0371, lr_0 = 9.9399e-04
Validation auc = 0.718717
Epoch 8563
Loss = 1.1987e-02, PNorm = 502.5265, GNorm = 0.0403, lr_0 = 9.9399e-04
Validation auc = 0.718375
Epoch 8564
Loss = 9.6549e-03, PNorm = 502.5382, GNorm = 1.1135, lr_0 = 9.9399e-04
Validation auc = 0.718173
Epoch 8565
Loss = 5.3252e-02, PNorm = 502.5478, GNorm = 0.0648, lr_0 = 9.9399e-04
Validation auc = 0.717521
Epoch 8566
Loss = 1.9342e-02, PNorm = 502.5638, GNorm = 0.3917, lr_0 = 9.9399e-04
Validation auc = 0.718386
Epoch 8567
Loss = 5.5674e-03, PNorm = 502.5834, GNorm = 1.1032, lr_0 = 9.9399e-04
Validation auc = 0.720919
Epoch 8568
Loss = 3.4919e-02, PNorm = 502.6124, GNorm = 0.8317, lr_0 = 9.9399e-04
Validation auc = 0.723073
Epoch 8569
Loss = 5.9482e-03, PNorm = 502.6391, GNorm = 0.1681, lr_0 = 9.9399e-04
Loss = 4.1974e-02, PNorm = 502.6605, GNorm = 6.6872, lr_0 = 9.9399e-04
Validation auc = 0.725426
Epoch 8570
Loss = 1.5721e-02, PNorm = 502.6908, GNorm = 0.0717, lr_0 = 9.9399e-04
Validation auc = 0.724411
Epoch 8571
Loss = 5.6974e-03, PNorm = 502.7174, GNorm = 0.0276, lr_0 = 9.9399e-04
Validation auc = 0.723686
Epoch 8572
Loss = 3.4293e-02, PNorm = 502.7401, GNorm = 1.2620, lr_0 = 9.9399e-04
Validation auc = 0.719517
Epoch 8573
Loss = 2.5540e-02, PNorm = 502.7721, GNorm = 2.8609, lr_0 = 9.9399e-04
Validation auc = 0.719659
Epoch 8574
Loss = 3.2673e-03, PNorm = 502.8175, GNorm = 0.4808, lr_0 = 9.9398e-04
Validation auc = 0.721534
Epoch 8575
Loss = 3.6313e-02, PNorm = 502.8506, GNorm = 0.0553, lr_0 = 9.9398e-04
Validation auc = 0.728824
Epoch 8576
Loss = 2.8450e-03, PNorm = 502.8768, GNorm = 0.0237, lr_0 = 9.9398e-04
Validation auc = 0.734367
Epoch 8577
Loss = 1.4603e-02, PNorm = 502.8951, GNorm = 0.0490, lr_0 = 9.9398e-04
Validation auc = 0.728795
Epoch 8578
Loss = 3.4086e-02, PNorm = 502.9227, GNorm = 0.9937, lr_0 = 9.9398e-04
Validation auc = 0.737720
Epoch 8579
Loss = 2.4706e-02, PNorm = 502.9728, GNorm = 0.9596, lr_0 = 9.9398e-04
Loss = 4.6314e-02, PNorm = 503.0201, GNorm = 2.8168, lr_0 = 9.9398e-04
Validation auc = 0.738618
Epoch 8580
Loss = 2.2623e-02, PNorm = 503.0581, GNorm = 2.5663, lr_0 = 9.9398e-04
Validation auc = 0.739197
Epoch 8581
Loss = 1.9412e-02, PNorm = 503.0899, GNorm = 0.9028, lr_0 = 9.9398e-04
Validation auc = 0.732995
Epoch 8582
Loss = 9.0804e-03, PNorm = 503.1291, GNorm = 0.1023, lr_0 = 9.9398e-04
Validation auc = 0.729345
Epoch 8583
Loss = 1.0926e-01, PNorm = 503.1552, GNorm = 0.2962, lr_0 = 9.9398e-04
Validation auc = 0.726710
Epoch 8584
Loss = 3.0003e-02, PNorm = 503.1784, GNorm = 0.3169, lr_0 = 9.9398e-04
Validation auc = 0.727049
Epoch 8585
Loss = 8.6509e-03, PNorm = 503.2016, GNorm = 0.1701, lr_0 = 9.9398e-04
Validation auc = 0.727577
Epoch 8586
Loss = 3.6383e-02, PNorm = 503.2355, GNorm = 1.4918, lr_0 = 9.9398e-04
Validation auc = 0.723885
Epoch 8587
Loss = 6.1093e-02, PNorm = 503.2799, GNorm = 1.6292, lr_0 = 9.9398e-04
Validation auc = 0.721496
Epoch 8588
Loss = 1.4349e-02, PNorm = 503.3166, GNorm = 0.3178, lr_0 = 9.9397e-04
Validation auc = 0.724377
Epoch 8589
Loss = 5.1337e-03, PNorm = 503.3440, GNorm = 0.2642, lr_0 = 9.9397e-04
Loss = 1.9296e-02, PNorm = 503.3689, GNorm = 0.5501, lr_0 = 9.9397e-04
Validation auc = 0.723242
Epoch 8590
Loss = 3.0500e-02, PNorm = 503.3986, GNorm = 0.2651, lr_0 = 9.9397e-04
Validation auc = 0.717690
Epoch 8591
Loss = 7.8457e-03, PNorm = 503.4208, GNorm = 0.0936, lr_0 = 9.9397e-04
Validation auc = 0.718264
Epoch 8592
Loss = 5.1165e-02, PNorm = 503.4365, GNorm = 0.1900, lr_0 = 9.9397e-04
Validation auc = 0.724040
Epoch 8593
Loss = 2.0722e-02, PNorm = 503.4522, GNorm = 0.3105, lr_0 = 9.9397e-04
Validation auc = 0.722034
Epoch 8594
Loss = 1.8253e-02, PNorm = 503.4724, GNorm = 0.7716, lr_0 = 9.9397e-04
Validation auc = 0.728151
Epoch 8595
Loss = 1.4988e-02, PNorm = 503.4946, GNorm = 0.4305, lr_0 = 9.9397e-04
Validation auc = 0.729165
Epoch 8596
Loss = 2.6824e-02, PNorm = 503.5188, GNorm = 0.9860, lr_0 = 9.9397e-04
Validation auc = 0.726934
Epoch 8597
Loss = 1.2128e-02, PNorm = 503.5427, GNorm = 0.0592, lr_0 = 9.9397e-04
Validation auc = 0.724081
Epoch 8598
Loss = 2.9256e-03, PNorm = 503.5621, GNorm = 0.4297, lr_0 = 9.9397e-04
Validation auc = 0.711062
Epoch 8599
Loss = 2.7999e-02, PNorm = 503.5780, GNorm = 1.2440, lr_0 = 9.9397e-04
Loss = 1.6057e-02, PNorm = 503.5992, GNorm = 0.0603, lr_0 = 9.9397e-04
Validation auc = 0.709446
Epoch 8600
Loss = 3.8670e-02, PNorm = 503.6291, GNorm = 0.4132, lr_0 = 9.9396e-04
Validation auc = 0.708988
Epoch 8601
Loss = 6.9876e-03, PNorm = 503.6594, GNorm = 0.1620, lr_0 = 9.9396e-04
Validation auc = 0.705147
Epoch 8602
Loss = 2.1795e-02, PNorm = 503.6802, GNorm = 0.2695, lr_0 = 9.9396e-04
Validation auc = 0.707060
Epoch 8603
Loss = 8.6982e-03, PNorm = 503.6965, GNorm = 0.8557, lr_0 = 9.9396e-04
Validation auc = 0.709354
Epoch 8604
Loss = 6.4513e-03, PNorm = 503.7121, GNorm = 0.2337, lr_0 = 9.9396e-04
Validation auc = 0.710880
Epoch 8605
Loss = 4.1190e-02, PNorm = 503.7374, GNorm = 0.0209, lr_0 = 9.9396e-04
Validation auc = 0.708079
Epoch 8606
Loss = 4.6539e-03, PNorm = 503.7622, GNorm = 0.1054, lr_0 = 9.9396e-04
Validation auc = 0.705354
Epoch 8607
Loss = 1.0478e-02, PNorm = 503.7804, GNorm = 1.5216, lr_0 = 9.9396e-04
Validation auc = 0.703269
Epoch 8608
Loss = 6.4818e-03, PNorm = 503.7984, GNorm = 0.4725, lr_0 = 9.9396e-04
Validation auc = 0.702109
Epoch 8609
Loss = 1.3765e-03, PNorm = 503.8153, GNorm = 0.0720, lr_0 = 9.9396e-04
Loss = 2.2960e-02, PNorm = 503.8290, GNorm = 0.3076, lr_0 = 9.9396e-04
Validation auc = 0.700030
Epoch 8610
Loss = 2.0522e-02, PNorm = 503.8426, GNorm = 0.0888, lr_0 = 9.9396e-04
Validation auc = 0.700848
Epoch 8611
Loss = 2.8035e-02, PNorm = 503.8644, GNorm = 4.1792, lr_0 = 9.9396e-04
Validation auc = 0.705826
Epoch 8612
Loss = 3.8433e-02, PNorm = 503.8895, GNorm = 0.0424, lr_0 = 9.9396e-04
Validation auc = 0.706477
Epoch 8613
Loss = 3.8355e-02, PNorm = 503.9166, GNorm = 4.2587, lr_0 = 9.9396e-04
Validation auc = 0.707186
Epoch 8614
Loss = 5.1603e-03, PNorm = 503.9507, GNorm = 0.0567, lr_0 = 9.9395e-04
Validation auc = 0.710135
Epoch 8615
Loss = 4.6859e-02, PNorm = 503.9841, GNorm = 6.0578, lr_0 = 9.9395e-04
Validation auc = 0.710849
Epoch 8616
Loss = 1.0328e-02, PNorm = 504.0184, GNorm = 0.1124, lr_0 = 9.9395e-04
Validation auc = 0.713157
Epoch 8617
Loss = 9.2020e-03, PNorm = 504.0481, GNorm = 0.3860, lr_0 = 9.9395e-04
Validation auc = 0.711554
Epoch 8618
Loss = 5.6667e-03, PNorm = 504.0746, GNorm = 0.7434, lr_0 = 9.9395e-04
Validation auc = 0.714432
Epoch 8619
Loss = 4.6033e-03, PNorm = 504.1022, GNorm = 0.4497, lr_0 = 9.9395e-04
Loss = 1.2770e-02, PNorm = 504.1356, GNorm = 0.1272, lr_0 = 9.9395e-04
Validation auc = 0.709419
Epoch 8620
Loss = 2.4684e-02, PNorm = 504.1614, GNorm = 4.8503, lr_0 = 9.9395e-04
Validation auc = 0.704706
Epoch 8621
Loss = 1.0355e-02, PNorm = 504.1890, GNorm = 0.1056, lr_0 = 9.9395e-04
Validation auc = 0.701832
Epoch 8622
Loss = 1.7734e-02, PNorm = 504.2087, GNorm = 2.3219, lr_0 = 9.9395e-04
Validation auc = 0.703365
Epoch 8623
Loss = 3.8739e-02, PNorm = 504.2330, GNorm = 3.1141, lr_0 = 9.9395e-04
Validation auc = 0.706795
Epoch 8624
Loss = 1.8803e-02, PNorm = 504.2594, GNorm = 0.0991, lr_0 = 9.9395e-04
Validation auc = 0.700956
Epoch 8625
Loss = 7.5262e-02, PNorm = 504.2897, GNorm = 0.6557, lr_0 = 9.9395e-04
Validation auc = 0.716160
Epoch 8626
Loss = 9.6636e-03, PNorm = 504.3291, GNorm = 0.8699, lr_0 = 9.9395e-04
Validation auc = 0.716325
Epoch 8627
Loss = 3.6061e-02, PNorm = 504.3602, GNorm = 0.1368, lr_0 = 9.9395e-04
Validation auc = 0.714921
Epoch 8628
Loss = 3.1043e-02, PNorm = 504.3790, GNorm = 1.9300, lr_0 = 9.9394e-04
Validation auc = 0.704802
Epoch 8629
Loss = 1.0726e-02, PNorm = 504.3972, GNorm = 0.4461, lr_0 = 9.9394e-04
Loss = 1.1290e-02, PNorm = 504.4203, GNorm = 0.1114, lr_0 = 9.9394e-04
Validation auc = 0.705197
Epoch 8630
Loss = 3.2520e-02, PNorm = 504.4425, GNorm = 1.1548, lr_0 = 9.9394e-04
Validation auc = 0.703190
Epoch 8631
Loss = 2.1268e-02, PNorm = 504.4674, GNorm = 0.0721, lr_0 = 9.9394e-04
Validation auc = 0.701001
Epoch 8632
Loss = 1.2478e-02, PNorm = 504.4970, GNorm = 1.0853, lr_0 = 9.9394e-04
Validation auc = 0.697604
Epoch 8633
Loss = 2.0957e-03, PNorm = 504.5225, GNorm = 0.0679, lr_0 = 9.9394e-04
Validation auc = 0.699339
Epoch 8634
Loss = 2.1965e-02, PNorm = 504.5416, GNorm = 0.0851, lr_0 = 9.9394e-04
Validation auc = 0.698054
Epoch 8635
Loss = 5.4981e-03, PNorm = 504.5664, GNorm = 0.1995, lr_0 = 9.9394e-04
Validation auc = 0.694948
Epoch 8636
Loss = 5.7064e-03, PNorm = 504.6025, GNorm = 0.0728, lr_0 = 9.9394e-04
Validation auc = 0.715124
Epoch 8637
Loss = 8.9713e-03, PNorm = 504.6486, GNorm = 0.0531, lr_0 = 9.9394e-04
Validation auc = 0.725148
Epoch 8638
Loss = 6.7168e-03, PNorm = 504.6887, GNorm = 0.5109, lr_0 = 9.9394e-04
Validation auc = 0.724111
Epoch 8639
Loss = 1.3012e-02, PNorm = 504.7210, GNorm = 0.4584, lr_0 = 9.9394e-04
Loss = 1.7601e-02, PNorm = 504.7563, GNorm = 0.1931, lr_0 = 9.9394e-04
Validation auc = 0.724109
Epoch 8640
Loss = 5.7315e-02, PNorm = 504.7837, GNorm = 5.1446, lr_0 = 9.9393e-04
Validation auc = 0.722783
Epoch 8641
Loss = 2.1180e-02, PNorm = 504.8166, GNorm = 1.2861, lr_0 = 9.9393e-04
Validation auc = 0.733025
Epoch 8642
Loss = 5.5033e-02, PNorm = 504.8576, GNorm = 0.1667, lr_0 = 9.9393e-04
Validation auc = 0.737719
Epoch 8643
Loss = 2.1371e-02, PNorm = 504.8941, GNorm = 0.2899, lr_0 = 9.9393e-04
Validation auc = 0.738741
Epoch 8644
Loss = 1.8685e-02, PNorm = 504.9274, GNorm = 1.1859, lr_0 = 9.9393e-04
Validation auc = 0.738414
Epoch 8645
Loss = 1.1033e-02, PNorm = 504.9584, GNorm = 1.9805, lr_0 = 9.9393e-04
Validation auc = 0.729952
Epoch 8646
Loss = 2.6835e-02, PNorm = 504.9883, GNorm = 0.0513, lr_0 = 9.9393e-04
Validation auc = 0.729998
Epoch 8647
Loss = 2.9237e-02, PNorm = 505.0175, GNorm = 2.2779, lr_0 = 9.9393e-04
Validation auc = 0.730808
Epoch 8648
Loss = 3.2057e-03, PNorm = 505.0393, GNorm = 0.0899, lr_0 = 9.9393e-04
Validation auc = 0.732363
Epoch 8649
Loss = 6.5483e-03, PNorm = 505.0593, GNorm = 0.2857, lr_0 = 9.9393e-04
Loss = 3.9130e-02, PNorm = 505.0880, GNorm = 0.8376, lr_0 = 9.9393e-04
Validation auc = 0.734770
Epoch 8650
Loss = 1.0560e-02, PNorm = 505.1212, GNorm = 0.4172, lr_0 = 9.9393e-04
Validation auc = 0.740159
Epoch 8651
Loss = 5.2216e-03, PNorm = 505.1418, GNorm = 0.1904, lr_0 = 9.9393e-04
Validation auc = 0.740050
Epoch 8652
Loss = 9.4843e-03, PNorm = 505.1538, GNorm = 0.0095, lr_0 = 9.9393e-04
Validation auc = 0.739153
Epoch 8653
Loss = 3.3075e-03, PNorm = 505.1635, GNorm = 0.0031, lr_0 = 9.9393e-04
Validation auc = 0.740371
Epoch 8654
Loss = 5.0183e-03, PNorm = 505.1806, GNorm = 0.0902, lr_0 = 9.9392e-04
Validation auc = 0.735046
Epoch 8655
Loss = 3.8241e-02, PNorm = 505.2044, GNorm = 0.0810, lr_0 = 9.9392e-04
Validation auc = 0.738061
Epoch 8656
Loss = 3.2917e-02, PNorm = 505.2327, GNorm = 1.4609, lr_0 = 9.9392e-04
Validation auc = 0.739016
Epoch 8657
Loss = 1.3773e-03, PNorm = 505.2555, GNorm = 0.1580, lr_0 = 9.9392e-04
Validation auc = 0.736850
Epoch 8658
Loss = 1.9968e-02, PNorm = 505.2716, GNorm = 1.7683, lr_0 = 9.9392e-04
Validation auc = 0.740271
Epoch 8659
Loss = 1.0395e-02, PNorm = 505.2993, GNorm = 1.2392, lr_0 = 9.9392e-04
Loss = 1.0635e-02, PNorm = 505.3240, GNorm = 1.5033, lr_0 = 9.9392e-04
Validation auc = 0.739062
Epoch 8660
Loss = 8.5485e-03, PNorm = 505.3445, GNorm = 0.7191, lr_0 = 9.9392e-04
Validation auc = 0.730254
Epoch 8661
Loss = 1.6031e-02, PNorm = 505.3661, GNorm = 0.0474, lr_0 = 9.9392e-04
Validation auc = 0.729132
Epoch 8662
Loss = 6.2659e-02, PNorm = 505.4054, GNorm = 0.0610, lr_0 = 9.9392e-04
Validation auc = 0.734049
Epoch 8663
Loss = 7.0911e-03, PNorm = 505.4427, GNorm = 0.3183, lr_0 = 9.9392e-04
Validation auc = 0.733220
Epoch 8664
Loss = 3.0255e-02, PNorm = 505.4740, GNorm = 0.1445, lr_0 = 9.9392e-04
Validation auc = 0.728804
Epoch 8665
Loss = 2.6861e-02, PNorm = 505.5119, GNorm = 0.1305, lr_0 = 9.9392e-04
Validation auc = 0.731200
Epoch 8666
Loss = 1.0749e-02, PNorm = 505.5477, GNorm = 0.0804, lr_0 = 9.9392e-04
Validation auc = 0.727272
Epoch 8667
Loss = 6.0477e-02, PNorm = 505.5723, GNorm = 2.0267, lr_0 = 9.9391e-04
Validation auc = 0.722312
Epoch 8668
Loss = 4.5116e-03, PNorm = 505.5987, GNorm = 0.4901, lr_0 = 9.9391e-04
Validation auc = 0.721105
Epoch 8669
Loss = 8.0034e-03, PNorm = 505.6273, GNorm = 0.3866, lr_0 = 9.9391e-04
Loss = 3.2293e-02, PNorm = 505.6630, GNorm = 1.6286, lr_0 = 9.9391e-04
Validation auc = 0.728563
Epoch 8670
Loss = 3.3502e-02, PNorm = 505.6955, GNorm = 1.9544, lr_0 = 9.9391e-04
Validation auc = 0.727942
Epoch 8671
Loss = 1.6482e-02, PNorm = 505.7259, GNorm = 0.0461, lr_0 = 9.9391e-04
Validation auc = 0.727716
Epoch 8672
Loss = 3.7401e-02, PNorm = 505.7582, GNorm = 5.1658, lr_0 = 9.9391e-04
Validation auc = 0.729307
Epoch 8673
Loss = 1.6648e-02, PNorm = 505.7973, GNorm = 0.0663, lr_0 = 9.9391e-04
Validation auc = 0.728721
Epoch 8674
Loss = 3.8823e-02, PNorm = 505.8273, GNorm = 0.4410, lr_0 = 9.9391e-04
Validation auc = 0.730600
Epoch 8675
Loss = 8.7612e-03, PNorm = 505.8531, GNorm = 0.1093, lr_0 = 9.9391e-04
Validation auc = 0.730278
Epoch 8676
Loss = 3.4755e-03, PNorm = 505.8792, GNorm = 0.1034, lr_0 = 9.9391e-04
Validation auc = 0.728970
Epoch 8677
Loss = 4.9250e-02, PNorm = 505.9123, GNorm = 1.3491, lr_0 = 9.9391e-04
Validation auc = 0.734091
Epoch 8678
Loss = 3.1532e-02, PNorm = 505.9634, GNorm = 0.0714, lr_0 = 9.9391e-04
Validation auc = 0.724984
Epoch 8679
Loss = 6.5869e-02, PNorm = 506.0188, GNorm = 0.7591, lr_0 = 9.9391e-04
Loss = 1.1290e-02, PNorm = 506.0523, GNorm = 1.7695, lr_0 = 9.9391e-04
Validation auc = 0.723564
Epoch 8680
Loss = 4.6410e-02, PNorm = 506.0794, GNorm = 1.4948, lr_0 = 9.9390e-04
Validation auc = 0.721123
Epoch 8681
Loss = 3.6544e-02, PNorm = 506.1132, GNorm = 0.8830, lr_0 = 9.9390e-04
Validation auc = 0.725113
Epoch 8682
Loss = 4.5612e-02, PNorm = 506.1417, GNorm = 0.4358, lr_0 = 9.9390e-04
Validation auc = 0.726799
Epoch 8683
Loss = 2.1480e-02, PNorm = 506.1671, GNorm = 0.9316, lr_0 = 9.9390e-04
Validation auc = 0.733512
Epoch 8684
Loss = 2.2758e-02, PNorm = 506.1923, GNorm = 1.1545, lr_0 = 9.9390e-04
Validation auc = 0.739332
Epoch 8685
Loss = 7.8710e-03, PNorm = 506.2143, GNorm = 0.3620, lr_0 = 9.9390e-04
Validation auc = 0.740824
Epoch 8686
Loss = 1.3052e-02, PNorm = 506.2340, GNorm = 0.1968, lr_0 = 9.9390e-04
Validation auc = 0.740332
Epoch 8687
Loss = 1.5339e-02, PNorm = 506.2549, GNorm = 0.1736, lr_0 = 9.9390e-04
Validation auc = 0.740587
Epoch 8688
Loss = 7.3829e-03, PNorm = 506.2810, GNorm = 1.3223, lr_0 = 9.9390e-04
Validation auc = 0.738957
Epoch 8689
Loss = 4.2270e-02, PNorm = 506.3063, GNorm = 2.5100, lr_0 = 9.9390e-04
Loss = 5.4886e-02, PNorm = 506.3379, GNorm = 3.7500, lr_0 = 9.9390e-04
Validation auc = 0.727872
Epoch 8690
Loss = 3.2539e-02, PNorm = 506.3817, GNorm = 3.0967, lr_0 = 9.9390e-04
Validation auc = 0.737631
Epoch 8691
Loss = 1.7049e-02, PNorm = 506.4243, GNorm = 1.3350, lr_0 = 9.9390e-04
Validation auc = 0.733116
Epoch 8692
Loss = 2.8589e-02, PNorm = 506.4641, GNorm = 1.1136, lr_0 = 9.9390e-04
Validation auc = 0.727840
Epoch 8693
Loss = 4.5596e-02, PNorm = 506.4989, GNorm = 0.3488, lr_0 = 9.9390e-04
Validation auc = 0.728776
Epoch 8694
Loss = 5.6437e-02, PNorm = 506.5327, GNorm = 0.2479, lr_0 = 9.9389e-04
Validation auc = 0.723505
Epoch 8695
Loss = 1.3830e-02, PNorm = 506.5674, GNorm = 0.2753, lr_0 = 9.9389e-04
Validation auc = 0.725485
Epoch 8696
Loss = 6.2382e-03, PNorm = 506.5920, GNorm = 0.3322, lr_0 = 9.9389e-04
Validation auc = 0.723726
Epoch 8697
Loss = 1.2753e-02, PNorm = 506.6108, GNorm = 0.0369, lr_0 = 9.9389e-04
Validation auc = 0.720472
Epoch 8698
Loss = 2.7171e-01, PNorm = 506.6309, GNorm = 8.1953, lr_0 = 9.9389e-04
Validation auc = 0.721956
Epoch 8699
Loss = 3.8342e-03, PNorm = 506.6560, GNorm = 0.2205, lr_0 = 9.9389e-04
Loss = 2.4877e-02, PNorm = 506.6768, GNorm = 2.7144, lr_0 = 9.9389e-04
Validation auc = 0.722829
Epoch 8700
Loss = 2.0032e-02, PNorm = 506.6950, GNorm = 0.3352, lr_0 = 9.9389e-04
Validation auc = 0.718024
Epoch 8701
Loss = 2.3983e-02, PNorm = 506.7202, GNorm = 3.2588, lr_0 = 9.9389e-04
Validation auc = 0.726475
Epoch 8702
Loss = 3.2339e-02, PNorm = 506.7505, GNorm = 2.5660, lr_0 = 9.9389e-04
Validation auc = 0.729128
Epoch 8703
Loss = 1.5199e-02, PNorm = 506.7826, GNorm = 0.0666, lr_0 = 9.9389e-04
Validation auc = 0.729918
Epoch 8704
Loss = 1.5092e-02, PNorm = 506.8121, GNorm = 0.3477, lr_0 = 9.9389e-04
Validation auc = 0.732277
Epoch 8705
Loss = 5.4280e-02, PNorm = 506.8434, GNorm = 2.4559, lr_0 = 9.9389e-04
Validation auc = 0.739307
Epoch 8706
Loss = 1.7417e-02, PNorm = 506.8747, GNorm = 0.1720, lr_0 = 9.9389e-04
Validation auc = 0.739765
Epoch 8707
Loss = 6.8894e-03, PNorm = 506.9003, GNorm = 0.0631, lr_0 = 9.9388e-04
Validation auc = 0.737459
Epoch 8708
Loss = 1.7671e-02, PNorm = 506.9262, GNorm = 0.1698, lr_0 = 9.9388e-04
Validation auc = 0.740518
Epoch 8709
Loss = 5.3816e-03, PNorm = 506.9497, GNorm = 0.2185, lr_0 = 9.9388e-04
Loss = 2.6308e-02, PNorm = 506.9706, GNorm = 0.6163, lr_0 = 9.9388e-04
Validation auc = 0.740834
Epoch 8710
Loss = 6.5814e-03, PNorm = 506.9941, GNorm = 0.1525, lr_0 = 9.9388e-04
Validation auc = 0.738958
Epoch 8711
Loss = 1.4563e-02, PNorm = 507.0151, GNorm = 0.0477, lr_0 = 9.9388e-04
Validation auc = 0.740992
Epoch 8712
Loss = 3.2658e-02, PNorm = 507.0339, GNorm = 0.0526, lr_0 = 9.9388e-04
Validation auc = 0.746914
Epoch 8713
Loss = 3.3862e-03, PNorm = 507.0673, GNorm = 0.6358, lr_0 = 9.9388e-04
Validation auc = 0.747664
Epoch 8714
Loss = 2.8058e-02, PNorm = 507.0958, GNorm = 0.0229, lr_0 = 9.9388e-04
Validation auc = 0.749627
Epoch 8715
Loss = 9.6874e-02, PNorm = 507.1246, GNorm = 4.7866, lr_0 = 9.9388e-04
Validation auc = 0.737728
Epoch 8716
Loss = 2.8810e-02, PNorm = 507.1602, GNorm = 1.2412, lr_0 = 9.9388e-04
Validation auc = 0.748442
Epoch 8717
Loss = 4.5366e-02, PNorm = 507.2038, GNorm = 1.1138, lr_0 = 9.9388e-04
Validation auc = 0.757254
Epoch 8718
Loss = 6.7303e-03, PNorm = 507.2436, GNorm = 0.5784, lr_0 = 9.9388e-04
Validation auc = 0.754661
Epoch 8719
Loss = 1.1573e-01, PNorm = 507.2719, GNorm = 1.7750, lr_0 = 9.9388e-04
Loss = 2.1081e-02, PNorm = 507.2934, GNorm = 2.5462, lr_0 = 9.9388e-04
Validation auc = 0.755013
Epoch 8720
Loss = 2.4433e-02, PNorm = 507.3190, GNorm = 1.6741, lr_0 = 9.9387e-04
Validation auc = 0.746013
Epoch 8721
Loss = 1.4329e-02, PNorm = 507.3448, GNorm = 0.2004, lr_0 = 9.9387e-04
Validation auc = 0.750106
Epoch 8722
Loss = 1.2121e-02, PNorm = 507.3673, GNorm = 0.1054, lr_0 = 9.9387e-04
Validation auc = 0.744862
Epoch 8723
Loss = 2.0302e-02, PNorm = 507.3887, GNorm = 0.2009, lr_0 = 9.9387e-04
Validation auc = 0.742433
Epoch 8724
Loss = 2.7583e-02, PNorm = 507.4128, GNorm = 2.0400, lr_0 = 9.9387e-04
Validation auc = 0.737460
Epoch 8725
Loss = 5.0859e-02, PNorm = 507.4492, GNorm = 3.0531, lr_0 = 9.9387e-04
Validation auc = 0.730004
Epoch 8726
Loss = 6.6124e-03, PNorm = 507.4818, GNorm = 0.1247, lr_0 = 9.9387e-04
Validation auc = 0.721965
Epoch 8727
Loss = 6.6747e-03, PNorm = 507.5148, GNorm = 0.3743, lr_0 = 9.9387e-04
Validation auc = 0.721058
Epoch 8728
Loss = 5.0213e-02, PNorm = 507.5466, GNorm = 1.3255, lr_0 = 9.9387e-04
Validation auc = 0.724164
Epoch 8729
Loss = 5.3247e-03, PNorm = 507.5712, GNorm = 0.3003, lr_0 = 9.9387e-04
Loss = 4.9345e-02, PNorm = 507.5954, GNorm = 0.1642, lr_0 = 9.9387e-04
Validation auc = 0.712754
Epoch 8730
Loss = 1.0342e-02, PNorm = 507.6233, GNorm = 0.3089, lr_0 = 9.9387e-04
Validation auc = 0.707399
Epoch 8731
Loss = 1.8804e-02, PNorm = 507.6477, GNorm = 1.0867, lr_0 = 9.9387e-04
Validation auc = 0.716144
Epoch 8732
Loss = 9.1275e-03, PNorm = 507.6692, GNorm = 1.2575, lr_0 = 9.9387e-04
Validation auc = 0.718004
Epoch 8733
Loss = 1.4575e-02, PNorm = 507.6906, GNorm = 0.0413, lr_0 = 9.9386e-04
Validation auc = 0.713213
Epoch 8734
Loss = 4.2636e-03, PNorm = 507.7115, GNorm = 0.0518, lr_0 = 9.9386e-04
Validation auc = 0.709968
Epoch 8735
Loss = 4.5466e-02, PNorm = 507.7301, GNorm = 6.7052, lr_0 = 9.9386e-04
Validation auc = 0.707133
Epoch 8736
Loss = 1.9087e-02, PNorm = 507.7586, GNorm = 2.3587, lr_0 = 9.9386e-04
Validation auc = 0.708465
Epoch 8737
Loss = 1.1166e-02, PNorm = 507.7929, GNorm = 0.1362, lr_0 = 9.9386e-04
Validation auc = 0.712667
Epoch 8738
Loss = 2.5634e-02, PNorm = 507.8340, GNorm = 1.1972, lr_0 = 9.9386e-04
Validation auc = 0.709847
Epoch 8739
Loss = 2.1959e-02, PNorm = 507.8673, GNorm = 1.3090, lr_0 = 9.9386e-04
Loss = 4.2498e-02, PNorm = 507.9073, GNorm = 0.0508, lr_0 = 9.9386e-04
Validation auc = 0.702878
Epoch 8740
Loss = 2.4349e-02, PNorm = 507.9430, GNorm = 0.2535, lr_0 = 9.9386e-04
Validation auc = 0.697379
Epoch 8741
Loss = 3.6941e-02, PNorm = 507.9715, GNorm = 1.0375, lr_0 = 9.9386e-04
Validation auc = 0.701052
Epoch 8742
Loss = 1.1833e-02, PNorm = 507.9959, GNorm = 0.3682, lr_0 = 9.9386e-04
Validation auc = 0.703882
Epoch 8743
Loss = 5.7263e-02, PNorm = 508.0212, GNorm = 0.1767, lr_0 = 9.9386e-04
Validation auc = 0.694887
Epoch 8744
Loss = 1.7205e-02, PNorm = 508.0591, GNorm = 0.3326, lr_0 = 9.9386e-04
Validation auc = 0.695643
Epoch 8745
Loss = 2.6570e-02, PNorm = 508.0979, GNorm = 0.6803, lr_0 = 9.9386e-04
Validation auc = 0.700489
Epoch 8746
Loss = 4.3418e-02, PNorm = 508.1346, GNorm = 2.7382, lr_0 = 9.9386e-04
Validation auc = 0.701396
Epoch 8747
Loss = 2.0644e-02, PNorm = 508.1687, GNorm = 1.0323, lr_0 = 9.9385e-04
Validation auc = 0.707951
Epoch 8748
Loss = 5.7481e-03, PNorm = 508.2045, GNorm = 0.2611, lr_0 = 9.9385e-04
Validation auc = 0.705727
Epoch 8749
Loss = 9.3434e-03, PNorm = 508.2320, GNorm = 0.5568, lr_0 = 9.9385e-04
Loss = 1.9614e-02, PNorm = 508.2529, GNorm = 9.3340, lr_0 = 9.9385e-04
Validation auc = 0.710261
Epoch 8750
Loss = 5.2354e-03, PNorm = 508.2835, GNorm = 0.0931, lr_0 = 9.9385e-04
Validation auc = 0.713252
Epoch 8751
Loss = 4.0857e-03, PNorm = 508.3077, GNorm = 0.0878, lr_0 = 9.9385e-04
Validation auc = 0.710484
Epoch 8752
Loss = 3.9612e-02, PNorm = 508.3302, GNorm = 0.6230, lr_0 = 9.9385e-04
Validation auc = 0.706583
Epoch 8753
Loss = 9.3718e-03, PNorm = 508.3648, GNorm = 0.0787, lr_0 = 9.9385e-04
Validation auc = 0.711558
Epoch 8754
Loss = 5.0187e-03, PNorm = 508.3966, GNorm = 0.1203, lr_0 = 9.9385e-04
Validation auc = 0.710074
Epoch 8755
Loss = 6.6192e-02, PNorm = 508.4221, GNorm = 5.4872, lr_0 = 9.9385e-04
Validation auc = 0.719411
Epoch 8756
Loss = 6.2655e-02, PNorm = 508.4618, GNorm = 0.2325, lr_0 = 9.9385e-04
Validation auc = 0.702561
Epoch 8757
Loss = 5.8898e-02, PNorm = 508.5063, GNorm = 1.3115, lr_0 = 9.9385e-04
Validation auc = 0.701681
Epoch 8758
Loss = 3.4878e-02, PNorm = 508.5381, GNorm = 0.3474, lr_0 = 9.9385e-04
Validation auc = 0.700204
Epoch 8759
Loss = 1.7493e-02, PNorm = 508.5688, GNorm = 1.2937, lr_0 = 9.9385e-04
Loss = 4.2492e-02, PNorm = 508.6013, GNorm = 1.5545, lr_0 = 9.9385e-04
Validation auc = 0.705659
Epoch 8760
Loss = 2.2028e-02, PNorm = 508.6336, GNorm = 0.3775, lr_0 = 9.9384e-04
Validation auc = 0.715714
Epoch 8761
Loss = 1.0196e-01, PNorm = 508.6639, GNorm = 0.7107, lr_0 = 9.9384e-04
Validation auc = 0.713124
Epoch 8762
Loss = 4.4563e-02, PNorm = 508.6984, GNorm = 0.2010, lr_0 = 9.9384e-04
Validation auc = 0.710254
Epoch 8763
Loss = 4.3944e-02, PNorm = 508.7302, GNorm = 2.7333, lr_0 = 9.9384e-04
Validation auc = 0.712528
Epoch 8764
Loss = 2.8002e-02, PNorm = 508.7718, GNorm = 1.2544, lr_0 = 9.9384e-04
Validation auc = 0.712401
Epoch 8765
Loss = 3.0746e-02, PNorm = 508.8123, GNorm = 0.7500, lr_0 = 9.9384e-04
Validation auc = 0.712833
Epoch 8766
Loss = 3.6595e-02, PNorm = 508.8502, GNorm = 0.8366, lr_0 = 9.9384e-04
Validation auc = 0.714391
Epoch 8767
Loss = 2.3435e-02, PNorm = 508.8894, GNorm = 1.6122, lr_0 = 9.9384e-04
Validation auc = 0.715491
Epoch 8768
Loss = 4.2862e-03, PNorm = 508.9196, GNorm = 0.0101, lr_0 = 9.9384e-04
Validation auc = 0.717495
Epoch 8769
Loss = 1.4651e-02, PNorm = 508.9436, GNorm = 0.6602, lr_0 = 9.9384e-04
Loss = 2.4128e-02, PNorm = 508.9703, GNorm = 0.2080, lr_0 = 9.9384e-04
Validation auc = 0.713533
Epoch 8770
Loss = 1.4953e-02, PNorm = 508.9910, GNorm = 0.2764, lr_0 = 9.9384e-04
Validation auc = 0.710885
Epoch 8771
Loss = 8.7119e-03, PNorm = 509.0121, GNorm = 0.1354, lr_0 = 9.9384e-04
Validation auc = 0.706948
Epoch 8772
Loss = 8.0573e-03, PNorm = 509.0301, GNorm = 0.3648, lr_0 = 9.9384e-04
Validation auc = 0.705345
Epoch 8773
Loss = 2.7760e-02, PNorm = 509.0473, GNorm = 1.1805, lr_0 = 9.9383e-04
Validation auc = 0.704336
Epoch 8774
Loss = 7.4241e-02, PNorm = 509.0744, GNorm = 2.4690, lr_0 = 9.9383e-04
Validation auc = 0.707118
Epoch 8775
Loss = 7.5366e-02, PNorm = 509.1064, GNorm = 2.5682, lr_0 = 9.9383e-04
Validation auc = 0.705500
Epoch 8776
Loss = 2.8346e-03, PNorm = 509.1469, GNorm = 0.4316, lr_0 = 9.9383e-04
Validation auc = 0.705851
Epoch 8777
Loss = 1.1834e-02, PNorm = 509.1738, GNorm = 2.1022, lr_0 = 9.9383e-04
Validation auc = 0.708271
Epoch 8778
Loss = 1.1660e-02, PNorm = 509.1954, GNorm = 0.1139, lr_0 = 9.9383e-04
Validation auc = 0.709163
Epoch 8779
Loss = 7.1708e-02, PNorm = 509.2153, GNorm = 1.3291, lr_0 = 9.9383e-04
Loss = 3.8846e-02, PNorm = 509.2362, GNorm = 1.0847, lr_0 = 9.9383e-04
Validation auc = 0.708514
Epoch 8780
Loss = 9.6101e-03, PNorm = 509.2571, GNorm = 0.1920, lr_0 = 9.9383e-04
Validation auc = 0.710387
Epoch 8781
Loss = 1.7826e-02, PNorm = 509.2740, GNorm = 0.1059, lr_0 = 9.9383e-04
Validation auc = 0.710787
Epoch 8782
Loss = 8.7280e-03, PNorm = 509.2931, GNorm = 0.0525, lr_0 = 9.9383e-04
Validation auc = 0.713738
Epoch 8783
Loss = 7.4677e-02, PNorm = 509.3134, GNorm = 5.4586, lr_0 = 9.9383e-04
Validation auc = 0.722153
Epoch 8784
Loss = 1.3268e-02, PNorm = 509.3391, GNorm = 2.1699, lr_0 = 9.9383e-04
Validation auc = 0.725170
Epoch 8785
Loss = 2.0327e-02, PNorm = 509.3689, GNorm = 1.7072, lr_0 = 9.9383e-04
Validation auc = 0.726581
Epoch 8786
Loss = 3.0344e-02, PNorm = 509.3961, GNorm = 1.5595, lr_0 = 9.9383e-04
Validation auc = 0.722158
Epoch 8787
Loss = 5.3914e-02, PNorm = 509.4325, GNorm = 2.4255, lr_0 = 9.9382e-04
Validation auc = 0.723313
Epoch 8788
Loss = 1.3031e-01, PNorm = 509.4731, GNorm = 1.5139, lr_0 = 9.9382e-04
Validation auc = 0.720552
Epoch 8789
Loss = 5.1871e-03, PNorm = 509.5183, GNorm = 0.4768, lr_0 = 9.9382e-04
Loss = 2.0416e-02, PNorm = 509.5542, GNorm = 1.7950, lr_0 = 9.9382e-04
Validation auc = 0.721615
Epoch 8790
Loss = 3.9671e-02, PNorm = 509.5854, GNorm = 0.1341, lr_0 = 9.9382e-04
Validation auc = 0.719063
Epoch 8791
Loss = 3.7813e-02, PNorm = 509.6148, GNorm = 1.5485, lr_0 = 9.9382e-04
Validation auc = 0.722435
Epoch 8792
Loss = 1.8174e-02, PNorm = 509.6457, GNorm = 0.0998, lr_0 = 9.9382e-04
Validation auc = 0.722246
Epoch 8793
Loss = 2.3366e-02, PNorm = 509.6716, GNorm = 1.4980, lr_0 = 9.9382e-04
Validation auc = 0.721921
Epoch 8794
Loss = 8.2414e-03, PNorm = 509.6926, GNorm = 0.7059, lr_0 = 9.9382e-04
Validation auc = 0.723738
Epoch 8795
Loss = 1.2186e-02, PNorm = 509.7135, GNorm = 0.1751, lr_0 = 9.9382e-04
Validation auc = 0.718382
Epoch 8796
Loss = 6.3831e-03, PNorm = 509.7394, GNorm = 0.2584, lr_0 = 9.9382e-04
Validation auc = 0.720420
Epoch 8797
Loss = 8.8673e-02, PNorm = 509.7656, GNorm = 0.1473, lr_0 = 9.9382e-04
Validation auc = 0.721315
Epoch 8798
Loss = 3.6055e-02, PNorm = 509.7961, GNorm = 0.0877, lr_0 = 9.9382e-04
Validation auc = 0.724859
Epoch 8799
Loss = 6.4273e-03, PNorm = 509.8280, GNorm = 0.2332, lr_0 = 9.9382e-04
Loss = 2.4860e-02, PNorm = 509.8518, GNorm = 0.1766, lr_0 = 9.9382e-04
Validation auc = 0.726781
Epoch 8800
Loss = 3.8331e-02, PNorm = 509.8749, GNorm = 0.8600, lr_0 = 9.9381e-04
Validation auc = 0.725863
Epoch 8801
Loss = 2.9501e-02, PNorm = 509.9125, GNorm = 0.1067, lr_0 = 9.9381e-04
Validation auc = 0.722754
Epoch 8802
Loss = 7.8026e-03, PNorm = 509.9422, GNorm = 0.1044, lr_0 = 9.9381e-04
Validation auc = 0.725457
Epoch 8803
Loss = 8.9733e-03, PNorm = 509.9639, GNorm = 0.0541, lr_0 = 9.9381e-04
Validation auc = 0.726129
Epoch 8804
Loss = 1.3780e-02, PNorm = 509.9846, GNorm = 0.1059, lr_0 = 9.9381e-04
Validation auc = 0.723778
Epoch 8805
Loss = 1.8244e-03, PNorm = 510.0015, GNorm = 0.0486, lr_0 = 9.9381e-04
Validation auc = 0.723684
Epoch 8806
Loss = 3.4566e-02, PNorm = 510.0163, GNorm = 0.0401, lr_0 = 9.9381e-04
Validation auc = 0.726173
Epoch 8807
Loss = 5.2578e-02, PNorm = 510.0307, GNorm = 0.0170, lr_0 = 9.9381e-04
Validation auc = 0.727452
Epoch 8808
Loss = 3.3815e-03, PNorm = 510.0467, GNorm = 0.1342, lr_0 = 9.9381e-04
Validation auc = 0.730050
Epoch 8809
Loss = 1.6139e-02, PNorm = 510.0603, GNorm = 0.8815, lr_0 = 9.9381e-04
Loss = 1.0816e-02, PNorm = 510.0747, GNorm = 0.0972, lr_0 = 9.9381e-04
Validation auc = 0.733956
Epoch 8810
Loss = 1.6126e-02, PNorm = 510.0891, GNorm = 0.0930, lr_0 = 9.9381e-04
Validation auc = 0.738550
Epoch 8811
Loss = 2.7466e-02, PNorm = 510.1032, GNorm = 0.8085, lr_0 = 9.9381e-04
Validation auc = 0.740095
Epoch 8812
Loss = 1.3971e-02, PNorm = 510.1189, GNorm = 0.0402, lr_0 = 9.9381e-04
Validation auc = 0.736016
Epoch 8813
Loss = 1.7137e-02, PNorm = 510.1357, GNorm = 0.0800, lr_0 = 9.9380e-04
Validation auc = 0.736899
Epoch 8814
Loss = 8.1132e-03, PNorm = 510.1547, GNorm = 0.0899, lr_0 = 9.9380e-04
Validation auc = 0.739809
Epoch 8815
Loss = 6.0984e-03, PNorm = 510.1786, GNorm = 0.0367, lr_0 = 9.9380e-04
Validation auc = 0.743028
Epoch 8816
Loss = 4.2379e-02, PNorm = 510.2030, GNorm = 0.1049, lr_0 = 9.9380e-04
Validation auc = 0.741892
Epoch 8817
Loss = 5.9965e-02, PNorm = 510.2308, GNorm = 2.0376, lr_0 = 9.9380e-04
Validation auc = 0.733660
Epoch 8818
Loss = 1.2047e-03, PNorm = 510.2554, GNorm = 0.0510, lr_0 = 9.9380e-04
Validation auc = 0.730331
Epoch 8819
Loss = 1.6535e-02, PNorm = 510.2740, GNorm = 0.9794, lr_0 = 9.9380e-04
Loss = 4.1141e-02, PNorm = 510.2945, GNorm = 0.1027, lr_0 = 9.9380e-04
Validation auc = 0.725491
Epoch 8820
Loss = 9.0196e-03, PNorm = 510.3213, GNorm = 1.2729, lr_0 = 9.9380e-04
Validation auc = 0.728326
Epoch 8821
Loss = 4.1894e-03, PNorm = 510.3380, GNorm = 0.8467, lr_0 = 9.9380e-04
Validation auc = 0.726445
Epoch 8822
Loss = 7.5185e-03, PNorm = 510.3503, GNorm = 0.2271, lr_0 = 9.9380e-04
Validation auc = 0.728416
Epoch 8823
Loss = 1.0441e-02, PNorm = 510.3608, GNorm = 0.3086, lr_0 = 9.9380e-04
Validation auc = 0.727728
Epoch 8824
Loss = 3.8503e-02, PNorm = 510.3759, GNorm = 0.2244, lr_0 = 9.9380e-04
Validation auc = 0.731831
Epoch 8825
Loss = 2.5260e-02, PNorm = 510.3967, GNorm = 2.2490, lr_0 = 9.9380e-04
Validation auc = 0.729509
Epoch 8826
Loss = 9.2839e-03, PNorm = 510.4162, GNorm = 0.9539, lr_0 = 9.9380e-04
Validation auc = 0.730303
Epoch 8827
Loss = 4.4993e-03, PNorm = 510.4310, GNorm = 0.0238, lr_0 = 9.9379e-04
Validation auc = 0.728509
Epoch 8828
Loss = 2.1570e-02, PNorm = 510.4452, GNorm = 0.0444, lr_0 = 9.9379e-04
Validation auc = 0.727869
Epoch 8829
Loss = 7.2999e-04, PNorm = 510.4587, GNorm = 0.0356, lr_0 = 9.9379e-04
Loss = 1.6637e-02, PNorm = 510.4707, GNorm = 0.8011, lr_0 = 9.9379e-04
Validation auc = 0.726132
Epoch 8830
Loss = 1.0584e-02, PNorm = 510.4873, GNorm = 0.6444, lr_0 = 9.9379e-04
Validation auc = 0.734420
Epoch 8831
Loss = 2.2449e-02, PNorm = 510.5040, GNorm = 2.6303, lr_0 = 9.9379e-04
Validation auc = 0.737637
Epoch 8832
Loss = 1.1394e-02, PNorm = 510.5222, GNorm = 0.4825, lr_0 = 9.9379e-04
Validation auc = 0.741467
Epoch 8833
Loss = 2.1237e-03, PNorm = 510.5359, GNorm = 0.0433, lr_0 = 9.9379e-04
Validation auc = 0.738756
Epoch 8834
Loss = 1.4947e-02, PNorm = 510.5457, GNorm = 0.9338, lr_0 = 9.9379e-04
Validation auc = 0.732971
Epoch 8835
Loss = 3.5784e-02, PNorm = 510.5593, GNorm = 0.1858, lr_0 = 9.9379e-04
Validation auc = 0.726641
Epoch 8836
Loss = 3.7671e-03, PNorm = 510.5780, GNorm = 0.0793, lr_0 = 9.9379e-04
Validation auc = 0.724294
Epoch 8837
Loss = 2.4321e-03, PNorm = 510.5912, GNorm = 0.0658, lr_0 = 9.9379e-04
Validation auc = 0.727441
Epoch 8838
Loss = 3.6786e-02, PNorm = 510.6046, GNorm = 0.9260, lr_0 = 9.9379e-04
Validation auc = 0.726176
Epoch 8839
Loss = 2.8050e-03, PNorm = 510.6219, GNorm = 0.2062, lr_0 = 9.9379e-04
Loss = 5.0326e-03, PNorm = 510.6382, GNorm = 0.1109, lr_0 = 9.9378e-04
Validation auc = 0.725828
Epoch 8840
Loss = 1.3643e-02, PNorm = 510.6508, GNorm = 0.0493, lr_0 = 9.9378e-04
Validation auc = 0.731806
Epoch 8841
Loss = 2.4055e-02, PNorm = 510.6664, GNorm = 0.0894, lr_0 = 9.9378e-04
Validation auc = 0.726089
Epoch 8842
Loss = 1.0171e-02, PNorm = 510.6842, GNorm = 0.1114, lr_0 = 9.9378e-04
Validation auc = 0.716725
Epoch 8843
Loss = 4.2894e-02, PNorm = 510.7106, GNorm = 0.3738, lr_0 = 9.9378e-04
Validation auc = 0.722534
Epoch 8844
Loss = 4.3547e-02, PNorm = 510.7531, GNorm = 2.6268, lr_0 = 9.9378e-04
Validation auc = 0.723218
Epoch 8845
Loss = 8.9989e-03, PNorm = 510.7866, GNorm = 0.5543, lr_0 = 9.9378e-04
Validation auc = 0.722937
Epoch 8846
Loss = 1.0252e-01, PNorm = 510.8267, GNorm = 0.5501, lr_0 = 9.9378e-04
Validation auc = 0.726315
Epoch 8847
Loss = 5.1231e-03, PNorm = 510.8753, GNorm = 0.1246, lr_0 = 9.9378e-04
Validation auc = 0.727037
Epoch 8848
Loss = 1.2272e-02, PNorm = 510.9105, GNorm = 1.1030, lr_0 = 9.9378e-04
Validation auc = 0.730128
Epoch 8849
Loss = 6.8823e-03, PNorm = 510.9381, GNorm = 0.5438, lr_0 = 9.9378e-04
Loss = 7.2563e-02, PNorm = 510.9736, GNorm = 0.3672, lr_0 = 9.9378e-04
Validation auc = 0.731404
Epoch 8850
Loss = 2.7337e-02, PNorm = 511.0103, GNorm = 2.0490, lr_0 = 9.9378e-04
Validation auc = 0.724897
Epoch 8851
Loss = 5.8284e-02, PNorm = 511.0476, GNorm = 0.2759, lr_0 = 9.9378e-04
Validation auc = 0.726321
Epoch 8852
Loss = 4.3810e-02, PNorm = 511.0851, GNorm = 0.2397, lr_0 = 9.9378e-04
Validation auc = 0.721038
Epoch 8853
Loss = 2.9973e-02, PNorm = 511.1189, GNorm = 0.5281, lr_0 = 9.9377e-04
Validation auc = 0.723113
Epoch 8854
Loss = 3.4900e-02, PNorm = 511.1486, GNorm = 1.9823, lr_0 = 9.9377e-04
Validation auc = 0.725385
Epoch 8855
Loss = 2.0202e-02, PNorm = 511.1811, GNorm = 1.8542, lr_0 = 9.9377e-04
Validation auc = 0.727203
Epoch 8856
Loss = 2.6185e-02, PNorm = 511.2036, GNorm = 0.0634, lr_0 = 9.9377e-04
Validation auc = 0.730754
Epoch 8857
Loss = 1.2178e-02, PNorm = 511.2290, GNorm = 0.8955, lr_0 = 9.9377e-04
Validation auc = 0.730161
Epoch 8858
Loss = 3.4987e-02, PNorm = 511.2531, GNorm = 0.4357, lr_0 = 9.9377e-04
Validation auc = 0.730239
Epoch 8859
Loss = 4.9776e-02, PNorm = 511.2794, GNorm = 0.7409, lr_0 = 9.9377e-04
Loss = 1.6199e-02, PNorm = 511.2999, GNorm = 1.0423, lr_0 = 9.9377e-04
Validation auc = 0.734997
Epoch 8860
Loss = 1.7823e-02, PNorm = 511.3177, GNorm = 1.2697, lr_0 = 9.9377e-04
Validation auc = 0.742406
Epoch 8861
Loss = 1.3694e-02, PNorm = 511.3373, GNorm = 0.0213, lr_0 = 9.9377e-04
Validation auc = 0.745590
Epoch 8862
Loss = 3.8447e-02, PNorm = 511.3543, GNorm = 1.1429, lr_0 = 9.9377e-04
Validation auc = 0.746283
Epoch 8863
Loss = 1.5705e-02, PNorm = 511.3845, GNorm = 0.3151, lr_0 = 9.9377e-04
Validation auc = 0.742692
Epoch 8864
Loss = 1.7311e-02, PNorm = 511.4118, GNorm = 0.2908, lr_0 = 9.9377e-04
Validation auc = 0.747244
Epoch 8865
Loss = 1.8300e-02, PNorm = 511.4337, GNorm = 1.2931, lr_0 = 9.9377e-04
Validation auc = 0.752916
Epoch 8866
Loss = 2.4490e-02, PNorm = 511.4585, GNorm = 0.4190, lr_0 = 9.9377e-04
Validation auc = 0.757617
Epoch 8867
Loss = 7.6478e-02, PNorm = 511.4845, GNorm = 3.1325, lr_0 = 9.9376e-04
Validation auc = 0.753729
Epoch 8868
Loss = 3.0649e-02, PNorm = 511.5139, GNorm = 0.8242, lr_0 = 9.9376e-04
Validation auc = 0.749548
Epoch 8869
Loss = 1.0397e-01, PNorm = 511.5432, GNorm = 2.7334, lr_0 = 9.9376e-04
Loss = 1.2069e-02, PNorm = 511.5712, GNorm = 2.7839, lr_0 = 9.9376e-04
Validation auc = 0.740732
Epoch 8870
Loss = 2.8716e-02, PNorm = 511.5994, GNorm = 0.4102, lr_0 = 9.9376e-04
Validation auc = 0.739807
Epoch 8871
Loss = 2.0812e-02, PNorm = 511.6335, GNorm = 0.2915, lr_0 = 9.9376e-04
Validation auc = 0.738299
Epoch 8872
Loss = 1.4890e-02, PNorm = 511.6583, GNorm = 1.6659, lr_0 = 9.9376e-04
Validation auc = 0.735976
Epoch 8873
Loss = 3.8688e-02, PNorm = 511.6807, GNorm = 1.6995, lr_0 = 9.9376e-04
Validation auc = 0.734648
Epoch 8874
Loss = 2.5125e-02, PNorm = 511.7080, GNorm = 1.9260, lr_0 = 9.9376e-04
Validation auc = 0.734926
Epoch 8875
Loss = 4.5632e-02, PNorm = 511.7403, GNorm = 0.3183, lr_0 = 9.9376e-04
Validation auc = 0.731188
Epoch 8876
Loss = 1.4713e-02, PNorm = 511.7743, GNorm = 0.6010, lr_0 = 9.9376e-04
Validation auc = 0.725466
Epoch 8877
Loss = 9.8274e-03, PNorm = 511.8010, GNorm = 0.2890, lr_0 = 9.9376e-04
Validation auc = 0.728399
Epoch 8878
Loss = 2.5238e-03, PNorm = 511.8235, GNorm = 0.2122, lr_0 = 9.9376e-04
Validation auc = 0.734964
Epoch 8879
Loss = 2.7702e-02, PNorm = 511.8586, GNorm = 1.8142, lr_0 = 9.9376e-04
Loss = 6.8114e-02, PNorm = 511.9267, GNorm = 2.2862, lr_0 = 9.9375e-04
Validation auc = 0.734790
Epoch 8880
Loss = 4.5580e-02, PNorm = 511.9933, GNorm = 0.0211, lr_0 = 9.9375e-04
Validation auc = 0.726191
Epoch 8881
Loss = 4.1414e-02, PNorm = 512.0509, GNorm = 0.2322, lr_0 = 9.9375e-04
Validation auc = 0.723922
Epoch 8882
Loss = 7.0447e-02, PNorm = 512.1047, GNorm = 5.6390, lr_0 = 9.9375e-04
Validation auc = 0.726982
Epoch 8883
Loss = 4.1314e-02, PNorm = 512.1543, GNorm = 0.4751, lr_0 = 9.9375e-04
Validation auc = 0.727545
Epoch 8884
Loss = 7.6133e-02, PNorm = 512.1968, GNorm = 0.3924, lr_0 = 9.9375e-04
Validation auc = 0.724676
Epoch 8885
Loss = 6.5113e-02, PNorm = 512.2401, GNorm = 6.4776, lr_0 = 9.9375e-04
Validation auc = 0.723266
Epoch 8886
Loss = 1.9916e-02, PNorm = 512.2805, GNorm = 1.2775, lr_0 = 9.9375e-04
Validation auc = 0.717889
Epoch 8887
Loss = 1.0189e-01, PNorm = 512.3219, GNorm = 1.3626, lr_0 = 9.9375e-04
Validation auc = 0.717525
Epoch 8888
Loss = 3.7691e-02, PNorm = 512.3767, GNorm = 2.0303, lr_0 = 9.9375e-04
Validation auc = 0.717006
Epoch 8889
Loss = 2.1882e-02, PNorm = 512.4168, GNorm = 0.4911, lr_0 = 9.9375e-04
Loss = 4.8306e-02, PNorm = 512.4449, GNorm = 0.4093, lr_0 = 9.9375e-04
Validation auc = 0.720397
Epoch 8890
Loss = 4.1807e-02, PNorm = 512.4748, GNorm = 0.1506, lr_0 = 9.9375e-04
Validation auc = 0.720542
Epoch 8891
Loss = 3.2665e-02, PNorm = 512.5133, GNorm = 2.0490, lr_0 = 9.9375e-04
Validation auc = 0.718581
Epoch 8892
Loss = 3.3895e-02, PNorm = 512.5489, GNorm = 0.5900, lr_0 = 9.9375e-04
Validation auc = 0.720098
Epoch 8893
Loss = 5.8361e-02, PNorm = 512.5769, GNorm = 2.4498, lr_0 = 9.9374e-04
Validation auc = 0.720718
Epoch 8894
Loss = 1.9737e-02, PNorm = 512.6027, GNorm = 0.3796, lr_0 = 9.9374e-04
Validation auc = 0.722905
Epoch 8895
Loss = 4.3436e-02, PNorm = 512.6308, GNorm = 0.2638, lr_0 = 9.9374e-04
Validation auc = 0.730182
Epoch 8896
Loss = 1.1911e-02, PNorm = 512.6713, GNorm = 0.6728, lr_0 = 9.9374e-04
Validation auc = 0.732256
Epoch 8897
Loss = 3.9234e-03, PNorm = 512.7042, GNorm = 0.2548, lr_0 = 9.9374e-04
Validation auc = 0.731126
Epoch 8898
Loss = 1.2837e-02, PNorm = 512.7373, GNorm = 1.2102, lr_0 = 9.9374e-04
Validation auc = 0.730870
Epoch 8899
Loss = 1.4275e-02, PNorm = 512.7754, GNorm = 0.7234, lr_0 = 9.9374e-04
Loss = 5.2963e-02, PNorm = 512.8085, GNorm = 1.0836, lr_0 = 9.9374e-04
Validation auc = 0.735624
Epoch 8900
Loss = 2.0050e-02, PNorm = 512.8399, GNorm = 1.2292, lr_0 = 9.9374e-04
Validation auc = 0.740715
Epoch 8901
Loss = 3.1904e-02, PNorm = 512.8653, GNorm = 0.9698, lr_0 = 9.9374e-04
Validation auc = 0.743599
Epoch 8902
Loss = 6.0081e-02, PNorm = 512.8889, GNorm = 4.7956, lr_0 = 9.9374e-04
Validation auc = 0.744563
Epoch 8903
Loss = 2.5945e-02, PNorm = 512.9131, GNorm = 1.2910, lr_0 = 9.9374e-04
Validation auc = 0.748577
Epoch 8904
Loss = 9.7622e-03, PNorm = 512.9322, GNorm = 0.5291, lr_0 = 9.9374e-04
Validation auc = 0.747796
Epoch 8905
Loss = 1.5957e-02, PNorm = 512.9459, GNorm = 2.4640, lr_0 = 9.9374e-04
Validation auc = 0.748262
Epoch 8906
Loss = 5.0259e-03, PNorm = 512.9718, GNorm = 0.0598, lr_0 = 9.9373e-04
Validation auc = 0.749918
Epoch 8907
Loss = 7.2164e-03, PNorm = 512.9955, GNorm = 0.0552, lr_0 = 9.9373e-04
Validation auc = 0.749984
Epoch 8908
Loss = 8.8612e-03, PNorm = 513.0139, GNorm = 0.5397, lr_0 = 9.9373e-04
Validation auc = 0.747985
Epoch 8909
Loss = 2.8350e-03, PNorm = 513.0413, GNorm = 0.0778, lr_0 = 9.9373e-04
Loss = 1.8094e-02, PNorm = 513.0656, GNorm = 1.0548, lr_0 = 9.9373e-04
Validation auc = 0.747645
Epoch 8910
Loss = 1.6319e-02, PNorm = 513.0875, GNorm = 0.5716, lr_0 = 9.9373e-04
Validation auc = 0.744885
Epoch 8911
Loss = 3.2225e-02, PNorm = 513.1059, GNorm = 1.1939, lr_0 = 9.9373e-04
Validation auc = 0.737346
Epoch 8912
Loss = 6.3090e-02, PNorm = 513.1406, GNorm = 0.7765, lr_0 = 9.9373e-04
Validation auc = 0.730858
Epoch 8913
Loss = 6.9277e-03, PNorm = 513.1735, GNorm = 0.1927, lr_0 = 9.9373e-04
Validation auc = 0.729648
Epoch 8914
Loss = 3.6595e-02, PNorm = 513.2015, GNorm = 1.3911, lr_0 = 9.9373e-04
Validation auc = 0.731215
Epoch 8915
Loss = 3.1069e-02, PNorm = 513.2319, GNorm = 0.0646, lr_0 = 9.9373e-04
Validation auc = 0.739154
Epoch 8916
Loss = 6.0421e-03, PNorm = 513.2658, GNorm = 1.0223, lr_0 = 9.9373e-04
Validation auc = 0.744821
Epoch 8917
Loss = 3.4723e-02, PNorm = 513.2889, GNorm = 1.2538, lr_0 = 9.9373e-04
Validation auc = 0.746228
Epoch 8918
Loss = 1.5390e-02, PNorm = 513.3107, GNorm = 1.7688, lr_0 = 9.9373e-04
Validation auc = 0.748112
Epoch 8919
Loss = 1.0561e-02, PNorm = 513.3464, GNorm = 0.3545, lr_0 = 9.9373e-04
Loss = 2.0647e-02, PNorm = 513.3809, GNorm = 0.1684, lr_0 = 9.9372e-04
Validation auc = 0.749112
Epoch 8920
Loss = 2.4576e-02, PNorm = 513.4123, GNorm = 0.5410, lr_0 = 9.9372e-04
Validation auc = 0.742992
Epoch 8921
Loss = 2.6493e-02, PNorm = 513.4415, GNorm = 0.1017, lr_0 = 9.9372e-04
Validation auc = 0.736618
Epoch 8922
Loss = 2.4201e-02, PNorm = 513.4699, GNorm = 0.2261, lr_0 = 9.9372e-04
Validation auc = 0.729412
Epoch 8923
Loss = 2.4990e-02, PNorm = 513.5021, GNorm = 1.7540, lr_0 = 9.9372e-04
Validation auc = 0.731142
Epoch 8924
Loss = 2.0765e-02, PNorm = 513.5311, GNorm = 0.6270, lr_0 = 9.9372e-04
Validation auc = 0.738961
Epoch 8925
Loss = 1.0621e-02, PNorm = 513.5549, GNorm = 1.3560, lr_0 = 9.9372e-04
Validation auc = 0.739372
Epoch 8926
Loss = 9.9361e-03, PNorm = 513.5734, GNorm = 0.0854, lr_0 = 9.9372e-04
Validation auc = 0.741605
Epoch 8927
Loss = 3.8094e-02, PNorm = 513.5899, GNorm = 0.0439, lr_0 = 9.9372e-04
Validation auc = 0.743018
Epoch 8928
Loss = 2.9052e-03, PNorm = 513.6125, GNorm = 0.2448, lr_0 = 9.9372e-04
Validation auc = 0.739163
Epoch 8929
Loss = 2.1833e-01, PNorm = 513.6342, GNorm = 3.7327, lr_0 = 9.9372e-04
Loss = 1.0406e-02, PNorm = 513.6579, GNorm = 0.2117, lr_0 = 9.9372e-04
Validation auc = 0.732985
Epoch 8930
Loss = 9.2741e-03, PNorm = 513.6750, GNorm = 0.1559, lr_0 = 9.9372e-04
Validation auc = 0.733128
Epoch 8931
Loss = 6.1461e-02, PNorm = 513.6879, GNorm = 2.0773, lr_0 = 9.9372e-04
Validation auc = 0.734232
Epoch 8932
Loss = 3.8745e-02, PNorm = 513.7058, GNorm = 2.4614, lr_0 = 9.9372e-04
Validation auc = 0.739062
Epoch 8933
Loss = 2.9917e-02, PNorm = 513.7262, GNorm = 0.1662, lr_0 = 9.9371e-04
Validation auc = 0.741933
Epoch 8934
Loss = 3.2525e-02, PNorm = 513.7439, GNorm = 4.4546, lr_0 = 9.9371e-04
Validation auc = 0.747350
Epoch 8935
Loss = 2.0479e-02, PNorm = 513.7659, GNorm = 1.0176, lr_0 = 9.9371e-04
Validation auc = 0.745366
Epoch 8936
Loss = 2.6229e-02, PNorm = 513.7823, GNorm = 0.0747, lr_0 = 9.9371e-04
Validation auc = 0.747546
Epoch 8937
Loss = 4.7962e-03, PNorm = 513.7949, GNorm = 0.4118, lr_0 = 9.9371e-04
Validation auc = 0.744969
Epoch 8938
Loss = 3.2872e-02, PNorm = 513.8118, GNorm = 2.2876, lr_0 = 9.9371e-04
Validation auc = 0.745218
Epoch 8939
Loss = 7.1169e-03, PNorm = 513.8378, GNorm = 0.3031, lr_0 = 9.9371e-04
Loss = 2.8311e-02, PNorm = 513.8616, GNorm = 1.9490, lr_0 = 9.9371e-04
Validation auc = 0.739608
Epoch 8940
Loss = 1.6046e-02, PNorm = 513.8850, GNorm = 1.1447, lr_0 = 9.9371e-04
Validation auc = 0.734613
Epoch 8941
Loss = 6.2076e-02, PNorm = 513.9042, GNorm = 0.4922, lr_0 = 9.9371e-04
Validation auc = 0.734007
Epoch 8942
Loss = 2.0259e-02, PNorm = 513.9377, GNorm = 1.6805, lr_0 = 9.9371e-04
Validation auc = 0.735102
Epoch 8943
Loss = 4.2303e-02, PNorm = 513.9648, GNorm = 1.9525, lr_0 = 9.9371e-04
Validation auc = 0.731559
Epoch 8944
Loss = 5.3546e-02, PNorm = 513.9974, GNorm = 2.4166, lr_0 = 9.9371e-04
Validation auc = 0.732280
Epoch 8945
Loss = 1.8203e-02, PNorm = 514.0294, GNorm = 0.1346, lr_0 = 9.9371e-04
Validation auc = 0.737246
Epoch 8946
Loss = 2.4769e-02, PNorm = 514.0588, GNorm = 1.6833, lr_0 = 9.9370e-04
Validation auc = 0.745322
Epoch 8947
Loss = 2.4582e-02, PNorm = 514.0879, GNorm = 0.1309, lr_0 = 9.9370e-04
Validation auc = 0.745396
Epoch 8948
Loss = 2.5690e-02, PNorm = 514.1085, GNorm = 1.5466, lr_0 = 9.9370e-04
Validation auc = 0.745344
Epoch 8949
Loss = 5.7470e-03, PNorm = 514.1219, GNorm = 0.2282, lr_0 = 9.9370e-04
Loss = 5.8676e-02, PNorm = 514.1373, GNorm = 0.2168, lr_0 = 9.9370e-04
Validation auc = 0.746227
Epoch 8950
Loss = 1.0312e-02, PNorm = 514.1601, GNorm = 0.3735, lr_0 = 9.9370e-04
Validation auc = 0.751416
Epoch 8951
Loss = 2.2311e-02, PNorm = 514.1782, GNorm = 0.0254, lr_0 = 9.9370e-04
Validation auc = 0.753467
Epoch 8952
Loss = 2.0218e-02, PNorm = 514.2024, GNorm = 1.6212, lr_0 = 9.9370e-04
Validation auc = 0.750320
Epoch 8953
Loss = 3.5380e-02, PNorm = 514.2258, GNorm = 1.1837, lr_0 = 9.9370e-04
Validation auc = 0.745706
Epoch 8954
Loss = 1.1720e-02, PNorm = 514.2518, GNorm = 0.1085, lr_0 = 9.9370e-04
Validation auc = 0.744320
Epoch 8955
Loss = 9.0114e-03, PNorm = 514.2724, GNorm = 0.0389, lr_0 = 9.9370e-04
Validation auc = 0.745017
Epoch 8956
Loss = 9.7423e-02, PNorm = 514.2883, GNorm = 0.0793, lr_0 = 9.9370e-04
Validation auc = 0.738867
Epoch 8957
Loss = 1.1018e-01, PNorm = 514.3219, GNorm = 0.1317, lr_0 = 9.9370e-04
Validation auc = 0.733225
Epoch 8958
Loss = 8.2349e-03, PNorm = 514.3590, GNorm = 0.4006, lr_0 = 9.9370e-04
Validation auc = 0.731383
Epoch 8959
Loss = 3.3777e-03, PNorm = 514.3864, GNorm = 0.1477, lr_0 = 9.9370e-04
Loss = 8.4369e-03, PNorm = 514.4029, GNorm = 0.4045, lr_0 = 9.9369e-04
Validation auc = 0.732747
Epoch 8960
Loss = 1.1121e-02, PNorm = 514.4145, GNorm = 0.0471, lr_0 = 9.9369e-04
Validation auc = 0.733615
Epoch 8961
Loss = 1.8279e-02, PNorm = 514.4244, GNorm = 1.0730, lr_0 = 9.9369e-04
Validation auc = 0.732621
Epoch 8962
Loss = 8.0575e-03, PNorm = 514.4331, GNorm = 0.0924, lr_0 = 9.9369e-04
Validation auc = 0.731128
Epoch 8963
Loss = 1.6592e-02, PNorm = 514.4521, GNorm = 0.0698, lr_0 = 9.9369e-04
Validation auc = 0.728519
Epoch 8964
Loss = 3.6273e-03, PNorm = 514.4729, GNorm = 0.0739, lr_0 = 9.9369e-04
Validation auc = 0.726858
Epoch 8965
Loss = 1.5870e-02, PNorm = 514.4933, GNorm = 0.3746, lr_0 = 9.9369e-04
Validation auc = 0.730550
Epoch 8966
Loss = 4.8426e-02, PNorm = 514.5107, GNorm = 1.4770, lr_0 = 9.9369e-04
Validation auc = 0.724121
Epoch 8967
Loss = 7.5148e-02, PNorm = 514.5288, GNorm = 0.5220, lr_0 = 9.9369e-04
Validation auc = 0.718040
Epoch 8968
Loss = 2.2799e-02, PNorm = 514.5534, GNorm = 0.5631, lr_0 = 9.9369e-04
Validation auc = 0.725062
Epoch 8969
Loss = 1.4173e-02, PNorm = 514.5772, GNorm = 1.1789, lr_0 = 9.9369e-04
Loss = 2.5241e-02, PNorm = 514.5987, GNorm = 3.9822, lr_0 = 9.9369e-04
Validation auc = 0.725620
Epoch 8970
Loss = 2.3362e-02, PNorm = 514.6219, GNorm = 0.0092, lr_0 = 9.9369e-04
Validation auc = 0.724614
Epoch 8971
Loss = 6.1213e-03, PNorm = 514.6380, GNorm = 0.0936, lr_0 = 9.9369e-04
Validation auc = 0.716390
Epoch 8972
Loss = 3.4055e-02, PNorm = 514.6530, GNorm = 1.8977, lr_0 = 9.9369e-04
Validation auc = 0.713569
Epoch 8973
Loss = 1.4641e-02, PNorm = 514.6723, GNorm = 0.1277, lr_0 = 9.9368e-04
Validation auc = 0.711934
Epoch 8974
Loss = 1.9751e-02, PNorm = 514.6951, GNorm = 0.4984, lr_0 = 9.9368e-04
Validation auc = 0.721188
Epoch 8975
Loss = 9.8831e-03, PNorm = 514.7158, GNorm = 0.0533, lr_0 = 9.9368e-04
Validation auc = 0.721605
Epoch 8976
Loss = 3.2650e-02, PNorm = 514.7330, GNorm = 1.0541, lr_0 = 9.9368e-04
Validation auc = 0.718388
Epoch 8977
Loss = 1.2912e-02, PNorm = 514.7536, GNorm = 0.2250, lr_0 = 9.9368e-04
Validation auc = 0.723307
Epoch 8978
Loss = 3.5546e-03, PNorm = 514.7752, GNorm = 0.1292, lr_0 = 9.9368e-04
Validation auc = 0.718152
Epoch 8979
Loss = 1.1210e-03, PNorm = 514.8034, GNorm = 0.0583, lr_0 = 9.9368e-04
Loss = 2.1857e-02, PNorm = 514.8353, GNorm = 1.2068, lr_0 = 9.9368e-04
Validation auc = 0.733711
Epoch 8980
Loss = 1.0429e-02, PNorm = 514.8678, GNorm = 0.1137, lr_0 = 9.9368e-04
Validation auc = 0.733022
Epoch 8981
Loss = 1.2655e-02, PNorm = 514.8873, GNorm = 0.1223, lr_0 = 9.9368e-04
Validation auc = 0.733323
Epoch 8982
Loss = 2.7665e-03, PNorm = 514.9014, GNorm = 0.0238, lr_0 = 9.9368e-04
Validation auc = 0.724830
Epoch 8983
Loss = 5.2149e-03, PNorm = 514.9104, GNorm = 0.1435, lr_0 = 9.9368e-04
Validation auc = 0.728881
Epoch 8984
Loss = 3.8599e-02, PNorm = 514.9205, GNorm = 0.0131, lr_0 = 9.9368e-04
Validation auc = 0.727170
Epoch 8985
Loss = 1.8896e-02, PNorm = 514.9334, GNorm = 0.2614, lr_0 = 9.9368e-04
Validation auc = 0.720828
Epoch 8986
Loss = 8.0588e-03, PNorm = 514.9495, GNorm = 0.0721, lr_0 = 9.9367e-04
Validation auc = 0.726231
Epoch 8987
Loss = 4.3184e-03, PNorm = 514.9634, GNorm = 0.5375, lr_0 = 9.9367e-04
Validation auc = 0.726333
Epoch 8988
Loss = 6.1263e-02, PNorm = 514.9750, GNorm = 2.4413, lr_0 = 9.9367e-04
Validation auc = 0.723499
Epoch 8989
Loss = 1.8488e-03, PNorm = 514.9925, GNorm = 0.2092, lr_0 = 9.9367e-04
Loss = 4.6331e-02, PNorm = 515.0170, GNorm = 0.1962, lr_0 = 9.9367e-04
Validation auc = 0.724449
Epoch 8990
Loss = 2.5393e-02, PNorm = 515.0558, GNorm = 2.2557, lr_0 = 9.9367e-04
Validation auc = 0.729511
Epoch 8991
Loss = 1.3211e-02, PNorm = 515.0875, GNorm = 0.2084, lr_0 = 9.9367e-04
Validation auc = 0.727434
Epoch 8992
Loss = 1.2742e-02, PNorm = 515.1118, GNorm = 0.0789, lr_0 = 9.9367e-04
Validation auc = 0.735283
Epoch 8993
Loss = 2.8574e-02, PNorm = 515.1391, GNorm = 1.1452, lr_0 = 9.9367e-04
Validation auc = 0.733594
Epoch 8994
Loss = 1.6243e-02, PNorm = 515.1653, GNorm = 0.1598, lr_0 = 9.9367e-04
Validation auc = 0.732776
Epoch 8995
Loss = 5.6237e-02, PNorm = 515.1937, GNorm = 2.8657, lr_0 = 9.9367e-04
Validation auc = 0.726578
Epoch 8996
Loss = 2.8753e-02, PNorm = 515.2195, GNorm = 2.9263, lr_0 = 9.9367e-04
Validation auc = 0.723627
Epoch 8997
Loss = 3.4078e-02, PNorm = 515.2444, GNorm = 1.4247, lr_0 = 9.9367e-04
Validation auc = 0.730037
Epoch 8998
Loss = 7.9809e-03, PNorm = 515.2637, GNorm = 0.4353, lr_0 = 9.9367e-04
Validation auc = 0.731731
Epoch 8999
Loss = 3.7710e-03, PNorm = 515.2790, GNorm = 0.1220, lr_0 = 9.9367e-04
Loss = 3.0589e-02, PNorm = 515.2960, GNorm = 0.9530, lr_0 = 9.9366e-04
Validation auc = 0.727141
Epoch 9000
Loss = 1.8538e-02, PNorm = 515.3195, GNorm = 0.6753, lr_0 = 9.9366e-04
Validation auc = 0.726761
Epoch 9001
Loss = 1.4175e-02, PNorm = 515.3404, GNorm = 0.0726, lr_0 = 9.9366e-04
Validation auc = 0.726208
Epoch 9002
Loss = 4.3893e-03, PNorm = 515.3572, GNorm = 0.5913, lr_0 = 9.9366e-04
Validation auc = 0.723606
Epoch 9003
Loss = 8.5535e-03, PNorm = 515.3732, GNorm = 0.1520, lr_0 = 9.9366e-04
Validation auc = 0.721499
Epoch 9004
Loss = 7.2232e-03, PNorm = 515.3889, GNorm = 0.5886, lr_0 = 9.9366e-04
Validation auc = 0.721851
Epoch 9005
Loss = 2.7792e-02, PNorm = 515.4137, GNorm = 0.0766, lr_0 = 9.9366e-04
Validation auc = 0.733464
Epoch 9006
Loss = 4.6934e-03, PNorm = 515.4409, GNorm = 0.3408, lr_0 = 9.9366e-04
Validation auc = 0.739135
Epoch 9007
Loss = 1.2117e-02, PNorm = 515.4584, GNorm = 0.7408, lr_0 = 9.9366e-04
Validation auc = 0.735903
Epoch 9008
Loss = 6.4083e-02, PNorm = 515.4709, GNorm = 1.5524, lr_0 = 9.9366e-04
Validation auc = 0.734835
Epoch 9009
Loss = 4.3088e-02, PNorm = 515.4911, GNorm = 1.1199, lr_0 = 9.9366e-04
Loss = 1.7019e-02, PNorm = 515.5110, GNorm = 0.5916, lr_0 = 9.9366e-04
Validation auc = 0.737723
Epoch 9010
Loss = 3.2266e-02, PNorm = 515.5291, GNorm = 1.9918, lr_0 = 9.9366e-04
Validation auc = 0.737777
Epoch 9011
Loss = 1.0734e-02, PNorm = 515.5528, GNorm = 0.2161, lr_0 = 9.9366e-04
Validation auc = 0.738984
Epoch 9012
Loss = 2.6717e-02, PNorm = 515.5768, GNorm = 0.1097, lr_0 = 9.9365e-04
Validation auc = 0.733787
Epoch 9013
Loss = 2.1427e-02, PNorm = 515.6072, GNorm = 0.1634, lr_0 = 9.9365e-04
Validation auc = 0.724663
Epoch 9014
Loss = 3.6434e-02, PNorm = 515.6311, GNorm = 0.2158, lr_0 = 9.9365e-04
Validation auc = 0.730009
Epoch 9015
Loss = 1.9433e-02, PNorm = 515.6564, GNorm = 0.3057, lr_0 = 9.9365e-04
Validation auc = 0.734620
Epoch 9016
Loss = 5.9468e-03, PNorm = 515.6818, GNorm = 0.3118, lr_0 = 9.9365e-04
Validation auc = 0.733003
Epoch 9017
Loss = 3.0628e-03, PNorm = 515.7021, GNorm = 0.2842, lr_0 = 9.9365e-04
Validation auc = 0.730866
Epoch 9018
Loss = 3.7108e-02, PNorm = 515.7189, GNorm = 3.7206, lr_0 = 9.9365e-04
Validation auc = 0.729874
Epoch 9019
Loss = 7.3111e-04, PNorm = 515.7434, GNorm = 0.0402, lr_0 = 9.9365e-04
Loss = 1.9274e-02, PNorm = 515.7638, GNorm = 1.3814, lr_0 = 9.9365e-04
Validation auc = 0.728703
Epoch 9020
Loss = 9.8431e-03, PNorm = 515.7815, GNorm = 0.0603, lr_0 = 9.9365e-04
Validation auc = 0.719620
Epoch 9021
Loss = 5.0804e-03, PNorm = 515.7962, GNorm = 0.2983, lr_0 = 9.9365e-04
Validation auc = 0.718888
Epoch 9022
Loss = 1.8002e-02, PNorm = 515.8081, GNorm = 1.9104, lr_0 = 9.9365e-04
Validation auc = 0.711777
Epoch 9023
Loss = 6.1002e-03, PNorm = 515.8251, GNorm = 0.2690, lr_0 = 9.9365e-04
Validation auc = 0.717169
Epoch 9024
Loss = 1.0181e-02, PNorm = 515.8396, GNorm = 0.3416, lr_0 = 9.9365e-04
Validation auc = 0.713956
Epoch 9025
Loss = 5.4191e-03, PNorm = 515.8606, GNorm = 0.0451, lr_0 = 9.9365e-04
Validation auc = 0.701467
Epoch 9026
Loss = 1.3773e-02, PNorm = 515.8795, GNorm = 0.0392, lr_0 = 9.9364e-04
Validation auc = 0.700265
Epoch 9027
Loss = 7.6520e-03, PNorm = 515.9003, GNorm = 1.1727, lr_0 = 9.9364e-04
Validation auc = 0.692959
Epoch 9028
Loss = 1.3583e-03, PNorm = 515.9197, GNorm = 0.0709, lr_0 = 9.9364e-04
Validation auc = 0.685070
Epoch 9029
Loss = 4.0079e-03, PNorm = 515.9446, GNorm = 0.2306, lr_0 = 9.9364e-04
Loss = 5.3376e-03, PNorm = 515.9686, GNorm = 0.0138, lr_0 = 9.9364e-04
Validation auc = 0.685836
Epoch 9030
Loss = 2.8485e-02, PNorm = 515.9919, GNorm = 0.0556, lr_0 = 9.9364e-04
Validation auc = 0.688159
Epoch 9031
Loss = 6.8657e-02, PNorm = 516.0192, GNorm = 1.3278, lr_0 = 9.9364e-04
Validation auc = 0.691167
Epoch 9032
Loss = 2.9404e-02, PNorm = 516.0513, GNorm = 1.2060, lr_0 = 9.9364e-04
Validation auc = 0.691970
Epoch 9033
Loss = 8.5174e-03, PNorm = 516.0826, GNorm = 0.4535, lr_0 = 9.9364e-04
Validation auc = 0.698767
Epoch 9034
Loss = 8.1954e-03, PNorm = 516.1060, GNorm = 0.1255, lr_0 = 9.9364e-04
Validation auc = 0.706383
Epoch 9035
Loss = 1.4634e-02, PNorm = 516.1228, GNorm = 0.0425, lr_0 = 9.9364e-04
Validation auc = 0.707290
Epoch 9036
Loss = 1.7677e-02, PNorm = 516.1417, GNorm = 0.8011, lr_0 = 9.9364e-04
Validation auc = 0.696618
Epoch 9037
Loss = 5.0590e-02, PNorm = 516.1679, GNorm = 2.0796, lr_0 = 9.9364e-04
Validation auc = 0.686280
Epoch 9038
Loss = 7.1973e-02, PNorm = 516.2008, GNorm = 2.8224, lr_0 = 9.9364e-04
Validation auc = 0.683279
Epoch 9039
Loss = 3.4607e-03, PNorm = 516.2416, GNorm = 0.1314, lr_0 = 9.9364e-04
Loss = 1.4974e-02, PNorm = 516.2771, GNorm = 0.0401, lr_0 = 9.9363e-04
Validation auc = 0.697935
Epoch 9040
Loss = 6.0597e-02, PNorm = 516.3086, GNorm = 1.7830, lr_0 = 9.9363e-04
Validation auc = 0.707113
Epoch 9041
Loss = 1.6336e-02, PNorm = 516.3401, GNorm = 3.3861, lr_0 = 9.9363e-04
Validation auc = 0.708314
Epoch 9042
Loss = 3.2918e-02, PNorm = 516.3754, GNorm = 0.0825, lr_0 = 9.9363e-04
Validation auc = 0.719302
Epoch 9043
Loss = 3.6306e-02, PNorm = 516.4068, GNorm = 0.5643, lr_0 = 9.9363e-04
Validation auc = 0.727730
Epoch 9044
Loss = 1.8731e-02, PNorm = 516.4306, GNorm = 0.2831, lr_0 = 9.9363e-04
Validation auc = 0.730883
Epoch 9045
Loss = 1.6980e-02, PNorm = 516.4495, GNorm = 0.4195, lr_0 = 9.9363e-04
Validation auc = 0.724242
Epoch 9046
Loss = 9.7056e-03, PNorm = 516.4696, GNorm = 0.3915, lr_0 = 9.9363e-04
Validation auc = 0.723672
Epoch 9047
Loss = 5.3495e-03, PNorm = 516.4899, GNorm = 0.1316, lr_0 = 9.9363e-04
Validation auc = 0.721951
Epoch 9048
Loss = 1.0952e-01, PNorm = 516.5165, GNorm = 2.5655, lr_0 = 9.9363e-04
Validation auc = 0.715484
Epoch 9049
Loss = 2.8086e-03, PNorm = 516.5462, GNorm = 0.1640, lr_0 = 9.9363e-04
Loss = 1.7491e-02, PNorm = 516.5705, GNorm = 0.0154, lr_0 = 9.9363e-04
Validation auc = 0.716725
Epoch 9050
Loss = 5.0693e-02, PNorm = 516.5964, GNorm = 0.0526, lr_0 = 9.9363e-04
Validation auc = 0.717919
Epoch 9051
Loss = 1.0113e-02, PNorm = 516.6292, GNorm = 0.1539, lr_0 = 9.9363e-04
Validation auc = 0.717233
Epoch 9052
Loss = 1.5114e-02, PNorm = 516.6601, GNorm = 0.1769, lr_0 = 9.9362e-04
Validation auc = 0.726365
Epoch 9053
Loss = 2.7225e-02, PNorm = 516.6876, GNorm = 1.1034, lr_0 = 9.9362e-04
Validation auc = 0.722080
Epoch 9054
Loss = 4.4820e-02, PNorm = 516.7132, GNorm = 6.6822, lr_0 = 9.9362e-04
Validation auc = 0.725106
Epoch 9055
Loss = 2.5240e-02, PNorm = 516.7424, GNorm = 0.4876, lr_0 = 9.9362e-04
Validation auc = 0.722839
Epoch 9056
Loss = 1.3800e-02, PNorm = 516.7637, GNorm = 0.4642, lr_0 = 9.9362e-04
Validation auc = 0.721334
Epoch 9057
Loss = 2.9559e-02, PNorm = 516.7832, GNorm = 1.2586, lr_0 = 9.9362e-04
Validation auc = 0.717426
Epoch 9058
Loss = 7.6607e-03, PNorm = 516.7976, GNorm = 0.3118, lr_0 = 9.9362e-04
Validation auc = 0.724687
Epoch 9059
Loss = 1.0952e-02, PNorm = 516.8202, GNorm = 1.6256, lr_0 = 9.9362e-04
Loss = 4.2053e-02, PNorm = 516.8496, GNorm = 0.1644, lr_0 = 9.9362e-04
Validation auc = 0.724444
Epoch 9060
Loss = 3.3771e-02, PNorm = 516.8818, GNorm = 0.4241, lr_0 = 9.9362e-04
Validation auc = 0.723659
Epoch 9061
Loss = 1.1123e-02, PNorm = 516.9087, GNorm = 0.0654, lr_0 = 9.9362e-04
Validation auc = 0.724991
Epoch 9062
Loss = 4.0405e-02, PNorm = 516.9311, GNorm = 1.5057, lr_0 = 9.9362e-04
Validation auc = 0.724610
Epoch 9063
Loss = 3.4250e-02, PNorm = 516.9582, GNorm = 2.1421, lr_0 = 9.9362e-04
Validation auc = 0.711367
Epoch 9064
Loss = 1.1891e-02, PNorm = 516.9874, GNorm = 0.0798, lr_0 = 9.9362e-04
Validation auc = 0.711846
Epoch 9065
Loss = 6.1865e-02, PNorm = 517.0140, GNorm = 0.7659, lr_0 = 9.9362e-04
Validation auc = 0.716888
Epoch 9066
Loss = 2.2261e-02, PNorm = 517.0435, GNorm = 4.2006, lr_0 = 9.9361e-04
Validation auc = 0.720519
Epoch 9067
Loss = 1.1454e-02, PNorm = 517.0722, GNorm = 0.4552, lr_0 = 9.9361e-04
Validation auc = 0.720397
Epoch 9068
Loss = 1.8721e-02, PNorm = 517.0955, GNorm = 1.2864, lr_0 = 9.9361e-04
Validation auc = 0.708241
Epoch 9069
Loss = 8.7664e-02, PNorm = 517.1210, GNorm = 4.8227, lr_0 = 9.9361e-04
Loss = 2.5573e-02, PNorm = 517.1553, GNorm = 0.4318, lr_0 = 9.9361e-04
Validation auc = 0.714592
Epoch 9070
Loss = 6.0617e-02, PNorm = 517.1878, GNorm = 0.2760, lr_0 = 9.9361e-04
Validation auc = 0.716969
Epoch 9071
Loss = 1.6484e-02, PNorm = 517.2189, GNorm = 0.3017, lr_0 = 9.9361e-04
Validation auc = 0.716362
Epoch 9072
Loss = 1.5279e-02, PNorm = 517.2431, GNorm = 0.1157, lr_0 = 9.9361e-04
Validation auc = 0.711787
Epoch 9073
Loss = 3.8567e-02, PNorm = 517.2636, GNorm = 1.0324, lr_0 = 9.9361e-04
Validation auc = 0.704130
Epoch 9074
Loss = 4.1389e-02, PNorm = 517.3001, GNorm = 0.0715, lr_0 = 9.9361e-04
Validation auc = 0.718838
Epoch 9075
Loss = 9.9289e-03, PNorm = 517.3370, GNorm = 0.0677, lr_0 = 9.9361e-04
Validation auc = 0.718745
Epoch 9076
Loss = 2.0267e-02, PNorm = 517.3684, GNorm = 0.0974, lr_0 = 9.9361e-04
Validation auc = 0.718321
Epoch 9077
Loss = 7.3727e-02, PNorm = 517.3960, GNorm = 0.4446, lr_0 = 9.9361e-04
Validation auc = 0.725406
Epoch 9078
Loss = 3.2011e-02, PNorm = 517.4286, GNorm = 0.1553, lr_0 = 9.9361e-04
Validation auc = 0.727618
Epoch 9079
Loss = 7.8882e-03, PNorm = 517.4533, GNorm = 0.3281, lr_0 = 9.9360e-04
Loss = 3.0222e-02, PNorm = 517.4830, GNorm = 0.3992, lr_0 = 9.9360e-04
Validation auc = 0.725383
Epoch 9080
Loss = 2.5292e-02, PNorm = 517.5212, GNorm = 0.9451, lr_0 = 9.9360e-04
Validation auc = 0.731333
Epoch 9081
Loss = 8.9135e-03, PNorm = 517.5511, GNorm = 0.0979, lr_0 = 9.9360e-04
Validation auc = 0.732897
Epoch 9082
Loss = 4.6306e-02, PNorm = 517.5698, GNorm = 0.1541, lr_0 = 9.9360e-04
Validation auc = 0.729817
Epoch 9083
Loss = 1.6520e-02, PNorm = 517.5907, GNorm = 0.1587, lr_0 = 9.9360e-04
Validation auc = 0.724811
Epoch 9084
Loss = 1.9719e-02, PNorm = 517.6094, GNorm = 2.5926, lr_0 = 9.9360e-04
Validation auc = 0.721187
Epoch 9085
Loss = 9.3687e-03, PNorm = 517.6244, GNorm = 0.5160, lr_0 = 9.9360e-04
Validation auc = 0.717438
Epoch 9086
Loss = 8.6583e-02, PNorm = 517.6378, GNorm = 7.9476, lr_0 = 9.9360e-04
Validation auc = 0.722951
Epoch 9087
Loss = 4.3140e-02, PNorm = 517.6666, GNorm = 3.1448, lr_0 = 9.9360e-04
Validation auc = 0.726270
Epoch 9088
Loss = 6.5781e-02, PNorm = 517.6977, GNorm = 3.8541, lr_0 = 9.9360e-04
Validation auc = 0.733363
Epoch 9089
Loss = 2.6777e-02, PNorm = 517.7397, GNorm = 1.3457, lr_0 = 9.9360e-04
Loss = 2.8015e-02, PNorm = 517.7813, GNorm = 0.0586, lr_0 = 9.9360e-04
Validation auc = 0.730257
Epoch 9090
Loss = 9.7127e-03, PNorm = 517.8144, GNorm = 1.0008, lr_0 = 9.9360e-04
Validation auc = 0.727889
Epoch 9091
Loss = 4.8698e-02, PNorm = 517.8420, GNorm = 0.1946, lr_0 = 9.9360e-04
Validation auc = 0.728390
Epoch 9092
Loss = 6.1154e-02, PNorm = 517.8678, GNorm = 1.0523, lr_0 = 9.9359e-04
Validation auc = 0.733346
Epoch 9093
Loss = 1.4704e-02, PNorm = 517.9040, GNorm = 0.3868, lr_0 = 9.9359e-04
Validation auc = 0.735056
Epoch 9094
Loss = 2.3210e-02, PNorm = 517.9374, GNorm = 2.6397, lr_0 = 9.9359e-04
Validation auc = 0.718862
Epoch 9095
Loss = 2.2846e-02, PNorm = 517.9665, GNorm = 0.1862, lr_0 = 9.9359e-04
Validation auc = 0.720460
Epoch 9096
Loss = 2.0920e-02, PNorm = 517.9968, GNorm = 0.0404, lr_0 = 9.9359e-04
Validation auc = 0.726355
Epoch 9097
Loss = 3.9869e-02, PNorm = 518.0342, GNorm = 0.3783, lr_0 = 9.9359e-04
Validation auc = 0.717274
Epoch 9098
Loss = 2.1721e-02, PNorm = 518.0716, GNorm = 1.1810, lr_0 = 9.9359e-04
Validation auc = 0.698677
Epoch 9099
Loss = 1.9650e-02, PNorm = 518.1154, GNorm = 0.6201, lr_0 = 9.9359e-04
Loss = 2.3508e-02, PNorm = 518.1526, GNorm = 1.4147, lr_0 = 9.9359e-04
Validation auc = 0.692817
Epoch 9100
Loss = 7.9156e-02, PNorm = 518.1924, GNorm = 0.6562, lr_0 = 9.9359e-04
Validation auc = 0.699961
Epoch 9101
Loss = 2.0784e-02, PNorm = 518.2361, GNorm = 0.5269, lr_0 = 9.9359e-04
Validation auc = 0.699643
Epoch 9102
Loss = 1.2423e-02, PNorm = 518.2681, GNorm = 0.2650, lr_0 = 9.9359e-04
Validation auc = 0.700619
Epoch 9103
Loss = 2.8403e-02, PNorm = 518.3047, GNorm = 0.4105, lr_0 = 9.9359e-04
Validation auc = 0.705232
Epoch 9104
Loss = 2.4649e-02, PNorm = 518.3408, GNorm = 2.2647, lr_0 = 9.9359e-04
Validation auc = 0.709097
Epoch 9105
Loss = 4.5123e-03, PNorm = 518.3701, GNorm = 0.0796, lr_0 = 9.9359e-04
Validation auc = 0.709559
Epoch 9106
Loss = 1.5229e-02, PNorm = 518.3898, GNorm = 0.2200, lr_0 = 9.9358e-04
Validation auc = 0.715631
Epoch 9107
Loss = 2.1150e-02, PNorm = 518.4083, GNorm = 2.4334, lr_0 = 9.9358e-04
Validation auc = 0.718224
Epoch 9108
Loss = 1.0829e-02, PNorm = 518.4332, GNorm = 1.1360, lr_0 = 9.9358e-04
Validation auc = 0.718897
Epoch 9109
Loss = 4.1142e-02, PNorm = 518.4622, GNorm = 2.7136, lr_0 = 9.9358e-04
Loss = 1.1157e-02, PNorm = 518.4907, GNorm = 0.0626, lr_0 = 9.9358e-04
Validation auc = 0.717164
Epoch 9110
Loss = 5.2623e-03, PNorm = 518.5102, GNorm = 0.1829, lr_0 = 9.9358e-04
Validation auc = 0.715865
Epoch 9111
Loss = 4.1679e-02, PNorm = 518.5267, GNorm = 1.7059, lr_0 = 9.9358e-04
Validation auc = 0.717131
Epoch 9112
Loss = 1.2414e-02, PNorm = 518.5526, GNorm = 0.4032, lr_0 = 9.9358e-04
Validation auc = 0.720744
Epoch 9113
Loss = 2.2688e-02, PNorm = 518.5743, GNorm = 0.0333, lr_0 = 9.9358e-04
Validation auc = 0.717235
Epoch 9114
Loss = 1.3173e-02, PNorm = 518.5916, GNorm = 0.0820, lr_0 = 9.9358e-04
Validation auc = 0.719751
Epoch 9115
Loss = 8.8012e-03, PNorm = 518.6126, GNorm = 0.0560, lr_0 = 9.9358e-04
Validation auc = 0.715526
Epoch 9116
Loss = 3.5712e-02, PNorm = 518.6351, GNorm = 0.0729, lr_0 = 9.9358e-04
Validation auc = 0.716873
Epoch 9117
Loss = 2.7773e-03, PNorm = 518.6578, GNorm = 0.3597, lr_0 = 9.9358e-04
Validation auc = 0.715102
Epoch 9118
Loss = 1.1580e-03, PNorm = 518.6725, GNorm = 0.0885, lr_0 = 9.9358e-04
Validation auc = 0.715835
Epoch 9119
Loss = 2.5260e-03, PNorm = 518.6865, GNorm = 0.2211, lr_0 = 9.9357e-04
Loss = 2.5591e-02, PNorm = 518.7098, GNorm = 0.2918, lr_0 = 9.9357e-04
Validation auc = 0.715864
Epoch 9120
Loss = 2.1692e-02, PNorm = 518.7379, GNorm = 0.6474, lr_0 = 9.9357e-04
Validation auc = 0.722266
Epoch 9121
Loss = 6.0198e-02, PNorm = 518.7640, GNorm = 0.8474, lr_0 = 9.9357e-04
Validation auc = 0.730102
Epoch 9122
Loss = 2.3611e-02, PNorm = 518.7944, GNorm = 1.6263, lr_0 = 9.9357e-04
Validation auc = 0.735246
Epoch 9123
Loss = 2.2421e-02, PNorm = 518.8258, GNorm = 1.3261, lr_0 = 9.9357e-04
Validation auc = 0.737582
Epoch 9124
Loss = 5.9829e-02, PNorm = 518.8609, GNorm = 2.7195, lr_0 = 9.9357e-04
Validation auc = 0.734291
Epoch 9125
Loss = 3.4966e-03, PNorm = 518.9074, GNorm = 0.2161, lr_0 = 9.9357e-04
Validation auc = 0.729312
Epoch 9126
Loss = 5.3376e-03, PNorm = 518.9493, GNorm = 0.8801, lr_0 = 9.9357e-04
Validation auc = 0.729971
Epoch 9127
Loss = 2.7712e-02, PNorm = 518.9849, GNorm = 1.3839, lr_0 = 9.9357e-04
Validation auc = 0.731482
Epoch 9128
Loss = 5.4400e-03, PNorm = 519.0175, GNorm = 0.7882, lr_0 = 9.9357e-04
Validation auc = 0.726595
Epoch 9129
Loss = 1.1544e-02, PNorm = 519.0397, GNorm = 0.7573, lr_0 = 9.9357e-04
Loss = 4.0332e-02, PNorm = 519.0593, GNorm = 0.1212, lr_0 = 9.9357e-04
Validation auc = 0.720419
Epoch 9130
Loss = 3.9677e-02, PNorm = 519.0891, GNorm = 0.3833, lr_0 = 9.9357e-04
Validation auc = 0.721540
Epoch 9131
Loss = 1.4174e-02, PNorm = 519.1210, GNorm = 0.4977, lr_0 = 9.9357e-04
Validation auc = 0.722290
Epoch 9132
Loss = 7.6329e-03, PNorm = 519.1412, GNorm = 1.1721, lr_0 = 9.9356e-04
Validation auc = 0.719570
Epoch 9133
Loss = 1.2380e-02, PNorm = 519.1628, GNorm = 0.0917, lr_0 = 9.9356e-04
Validation auc = 0.711274
Epoch 9134
Loss = 9.8344e-03, PNorm = 519.1856, GNorm = 0.6709, lr_0 = 9.9356e-04
Validation auc = 0.710528
Epoch 9135
Loss = 1.0313e-02, PNorm = 519.2154, GNorm = 0.8779, lr_0 = 9.9356e-04
Validation auc = 0.720595
Epoch 9136
Loss = 8.8965e-03, PNorm = 519.2437, GNorm = 2.1981, lr_0 = 9.9356e-04
Validation auc = 0.716258
Epoch 9137
Loss = 2.1230e-02, PNorm = 519.2733, GNorm = 3.9882, lr_0 = 9.9356e-04
Validation auc = 0.712981
Epoch 9138
Loss = 5.6858e-03, PNorm = 519.3069, GNorm = 0.4214, lr_0 = 9.9356e-04
Validation auc = 0.708641
Epoch 9139
Loss = 4.7634e-04, PNorm = 519.3342, GNorm = 0.0258, lr_0 = 9.9356e-04
Loss = 8.0364e-03, PNorm = 519.3562, GNorm = 0.0438, lr_0 = 9.9356e-04
Validation auc = 0.711327
Epoch 9140
Loss = 5.9070e-02, PNorm = 519.3858, GNorm = 1.0757, lr_0 = 9.9356e-04
Validation auc = 0.712344
Epoch 9141
Loss = 3.0798e-02, PNorm = 519.4246, GNorm = 1.1829, lr_0 = 9.9356e-04
Validation auc = 0.717465
Epoch 9142
Loss = 1.8114e-02, PNorm = 519.4619, GNorm = 0.0919, lr_0 = 9.9356e-04
Validation auc = 0.718291
Epoch 9143
Loss = 2.0910e-02, PNorm = 519.4980, GNorm = 0.9821, lr_0 = 9.9356e-04
Validation auc = 0.721025
Epoch 9144
Loss = 1.7719e-02, PNorm = 519.5265, GNorm = 1.3556, lr_0 = 9.9356e-04
Validation auc = 0.717314
Epoch 9145
Loss = 2.9810e-02, PNorm = 519.5521, GNorm = 2.2874, lr_0 = 9.9356e-04
Validation auc = 0.730563
Epoch 9146
Loss = 3.4772e-03, PNorm = 519.5837, GNorm = 0.1330, lr_0 = 9.9355e-04
Validation auc = 0.729756
Epoch 9147
Loss = 4.3395e-03, PNorm = 519.6121, GNorm = 0.1012, lr_0 = 9.9355e-04
Validation auc = 0.724065
Epoch 9148
Loss = 1.5264e-02, PNorm = 519.6378, GNorm = 0.7783, lr_0 = 9.9355e-04
Validation auc = 0.718142
Epoch 9149
Loss = 1.5987e-03, PNorm = 519.6651, GNorm = 0.0786, lr_0 = 9.9355e-04
Loss = 2.6255e-02, PNorm = 519.6871, GNorm = 3.3489, lr_0 = 9.9355e-04
Validation auc = 0.715248
Epoch 9150
Loss = 1.8335e-02, PNorm = 519.7134, GNorm = 0.6434, lr_0 = 9.9355e-04
Validation auc = 0.713782
Epoch 9151
Loss = 3.7281e-02, PNorm = 519.7341, GNorm = 2.1009, lr_0 = 9.9355e-04
Validation auc = 0.713695
Epoch 9152
Loss = 6.7937e-02, PNorm = 519.7612, GNorm = 5.8451, lr_0 = 9.9355e-04
Validation auc = 0.715529
Epoch 9153
Loss = 1.0990e-02, PNorm = 519.8001, GNorm = 1.7994, lr_0 = 9.9355e-04
Validation auc = 0.725163
Epoch 9154
Loss = 2.0696e-02, PNorm = 519.8410, GNorm = 0.6105, lr_0 = 9.9355e-04
Validation auc = 0.730601
Epoch 9155
Loss = 4.7625e-03, PNorm = 519.8769, GNorm = 0.7618, lr_0 = 9.9355e-04
Validation auc = 0.729666
Epoch 9156
Loss = 2.5903e-02, PNorm = 519.9048, GNorm = 0.0434, lr_0 = 9.9355e-04
Validation auc = 0.729918
Epoch 9157
Loss = 6.1907e-03, PNorm = 519.9248, GNorm = 0.7361, lr_0 = 9.9355e-04
Validation auc = 0.731881
Epoch 9158
Loss = 1.7668e-02, PNorm = 519.9417, GNorm = 1.0694, lr_0 = 9.9355e-04
Validation auc = 0.734195
Epoch 9159
Loss = 2.3357e-03, PNorm = 519.9629, GNorm = 0.1036, lr_0 = 9.9354e-04
Loss = 3.4650e-02, PNorm = 519.9818, GNorm = 0.3777, lr_0 = 9.9354e-04
Validation auc = 0.733009
Epoch 9160
Loss = 2.2628e-02, PNorm = 520.0097, GNorm = 0.0888, lr_0 = 9.9354e-04
Validation auc = 0.725464
Epoch 9161
Loss = 3.0065e-02, PNorm = 520.0411, GNorm = 2.0529, lr_0 = 9.9354e-04
Validation auc = 0.711369
Epoch 9162
Loss = 4.4230e-02, PNorm = 520.0779, GNorm = 3.6931, lr_0 = 9.9354e-04
Validation auc = 0.711839
Epoch 9163
Loss = 4.7176e-02, PNorm = 520.1379, GNorm = 0.3093, lr_0 = 9.9354e-04
Validation auc = 0.709618
Epoch 9164
Loss = 1.8833e-02, PNorm = 520.1898, GNorm = 0.9978, lr_0 = 9.9354e-04
Validation auc = 0.710797
Epoch 9165
Loss = 5.1959e-02, PNorm = 520.2248, GNorm = 0.8162, lr_0 = 9.9354e-04
Validation auc = 0.718591
Epoch 9166
Loss = 3.8468e-02, PNorm = 520.2547, GNorm = 0.2284, lr_0 = 9.9354e-04
Validation auc = 0.727700
Epoch 9167
Loss = 2.2187e-02, PNorm = 520.2856, GNorm = 0.1385, lr_0 = 9.9354e-04
Validation auc = 0.725667
Epoch 9168
Loss = 3.9324e-03, PNorm = 520.3133, GNorm = 0.3520, lr_0 = 9.9354e-04
Validation auc = 0.722704
Epoch 9169
Loss = 1.8756e-02, PNorm = 520.3404, GNorm = 0.8908, lr_0 = 9.9354e-04
Loss = 2.3033e-02, PNorm = 520.3785, GNorm = 0.2053, lr_0 = 9.9354e-04
Validation auc = 0.718297
Epoch 9170
Loss = 6.2005e-02, PNorm = 520.4115, GNorm = 1.3610, lr_0 = 9.9354e-04
Validation auc = 0.719524
Epoch 9171
Loss = 4.3661e-02, PNorm = 520.4429, GNorm = 0.8753, lr_0 = 9.9354e-04
Validation auc = 0.709836
Epoch 9172
Loss = 7.4284e-02, PNorm = 520.4816, GNorm = 1.8284, lr_0 = 9.9353e-04
Validation auc = 0.703987
Epoch 9173
Loss = 1.5131e-02, PNorm = 520.5214, GNorm = 0.1316, lr_0 = 9.9353e-04
Validation auc = 0.700769
Epoch 9174
Loss = 1.4879e-02, PNorm = 520.5559, GNorm = 0.1156, lr_0 = 9.9353e-04
Validation auc = 0.693420
Epoch 9175
Loss = 4.3916e-02, PNorm = 520.5925, GNorm = 1.1678, lr_0 = 9.9353e-04
Validation auc = 0.686217
Epoch 9176
Loss = 8.8923e-03, PNorm = 520.6378, GNorm = 0.0289, lr_0 = 9.9353e-04
Validation auc = 0.685308
Epoch 9177
Loss = 7.7818e-03, PNorm = 520.6793, GNorm = 0.7037, lr_0 = 9.9353e-04
Validation auc = 0.683569
Epoch 9178
Loss = 1.3881e-02, PNorm = 520.7261, GNorm = 0.4945, lr_0 = 9.9353e-04
Validation auc = 0.687146
Epoch 9179
Loss = 1.6015e-02, PNorm = 520.7664, GNorm = 0.7792, lr_0 = 9.9353e-04
Loss = 1.6961e-02, PNorm = 520.7960, GNorm = 0.2302, lr_0 = 9.9353e-04
Validation auc = 0.685732
Epoch 9180
Loss = 4.8863e-02, PNorm = 520.8248, GNorm = 0.0622, lr_0 = 9.9353e-04
Validation auc = 0.686885
Epoch 9181
Loss = 2.6879e-02, PNorm = 520.8599, GNorm = 4.1264, lr_0 = 9.9353e-04
Validation auc = 0.691202
Epoch 9182
Loss = 2.1627e-02, PNorm = 520.8952, GNorm = 1.8927, lr_0 = 9.9353e-04
Validation auc = 0.692391
Epoch 9183
Loss = 4.2634e-02, PNorm = 520.9242, GNorm = 1.3739, lr_0 = 9.9353e-04
Validation auc = 0.693530
Epoch 9184
Loss = 2.4036e-02, PNorm = 520.9545, GNorm = 0.0637, lr_0 = 9.9353e-04
Validation auc = 0.692462
Epoch 9185
Loss = 2.8015e-02, PNorm = 520.9838, GNorm = 0.1274, lr_0 = 9.9352e-04
Validation auc = 0.693856
Epoch 9186
Loss = 7.4532e-02, PNorm = 521.0121, GNorm = 0.3575, lr_0 = 9.9352e-04
Validation auc = 0.710542
Epoch 9187
Loss = 1.0788e-02, PNorm = 521.0433, GNorm = 0.3048, lr_0 = 9.9352e-04
Validation auc = 0.710489
Epoch 9188
Loss = 6.5384e-03, PNorm = 521.0752, GNorm = 0.7148, lr_0 = 9.9352e-04
Validation auc = 0.714078
Epoch 9189
Loss = 5.0376e-03, PNorm = 521.1028, GNorm = 0.2208, lr_0 = 9.9352e-04
Loss = 1.8259e-02, PNorm = 521.1326, GNorm = 0.1382, lr_0 = 9.9352e-04
Validation auc = 0.717511
Epoch 9190
Loss = 3.8163e-02, PNorm = 521.1576, GNorm = 0.1516, lr_0 = 9.9352e-04
Validation auc = 0.718154
Epoch 9191
Loss = 1.0253e-02, PNorm = 521.1799, GNorm = 0.7958, lr_0 = 9.9352e-04
Validation auc = 0.714465
Epoch 9192
Loss = 2.0683e-02, PNorm = 521.1994, GNorm = 0.0788, lr_0 = 9.9352e-04
Validation auc = 0.711686
Epoch 9193
Loss = 3.0153e-02, PNorm = 521.2370, GNorm = 0.0604, lr_0 = 9.9352e-04
Validation auc = 0.722312
Epoch 9194
Loss = 1.0549e-02, PNorm = 521.2783, GNorm = 0.0236, lr_0 = 9.9352e-04
Validation auc = 0.725958
Epoch 9195
Loss = 1.9285e-02, PNorm = 521.3071, GNorm = 0.2926, lr_0 = 9.9352e-04
Validation auc = 0.723098
Epoch 9196
Loss = 2.7809e-02, PNorm = 521.3312, GNorm = 0.1397, lr_0 = 9.9352e-04
Validation auc = 0.722723
Epoch 9197
Loss = 5.0241e-03, PNorm = 521.3558, GNorm = 0.2238, lr_0 = 9.9352e-04
Validation auc = 0.724356
Epoch 9198
Loss = 7.9858e-03, PNorm = 521.3882, GNorm = 0.0508, lr_0 = 9.9352e-04
Validation auc = 0.728643
Epoch 9199
Loss = 2.8380e-03, PNorm = 521.4170, GNorm = 0.0986, lr_0 = 9.9351e-04
Loss = 3.1961e-02, PNorm = 521.4417, GNorm = 1.7496, lr_0 = 9.9351e-04
Validation auc = 0.721588
Epoch 9200
Loss = 1.8720e-02, PNorm = 521.4640, GNorm = 0.2297, lr_0 = 9.9351e-04
Validation auc = 0.719511
Epoch 9201
Loss = 2.0649e-02, PNorm = 521.4827, GNorm = 0.0442, lr_0 = 9.9351e-04
Validation auc = 0.716969
Epoch 9202
Loss = 4.5420e-02, PNorm = 521.4999, GNorm = 0.3126, lr_0 = 9.9351e-04
Validation auc = 0.709519
Epoch 9203
Loss = 3.4183e-02, PNorm = 521.5322, GNorm = 0.0296, lr_0 = 9.9351e-04
Validation auc = 0.697677
Epoch 9204
Loss = 3.0333e-02, PNorm = 521.5629, GNorm = 0.7846, lr_0 = 9.9351e-04
Validation auc = 0.705741
Epoch 9205
Loss = 3.1697e-03, PNorm = 521.5934, GNorm = 0.2432, lr_0 = 9.9351e-04
Validation auc = 0.711661
Epoch 9206
Loss = 6.5144e-02, PNorm = 521.6139, GNorm = 0.0433, lr_0 = 9.9351e-04
Validation auc = 0.715410
Epoch 9207
Loss = 6.7856e-03, PNorm = 521.6471, GNorm = 1.4698, lr_0 = 9.9351e-04
Validation auc = 0.711034
Epoch 9208
Loss = 4.7941e-02, PNorm = 521.6770, GNorm = 0.2631, lr_0 = 9.9351e-04
Validation auc = 0.714798
Epoch 9209
Loss = 9.6877e-03, PNorm = 521.6985, GNorm = 0.2245, lr_0 = 9.9351e-04
Loss = 2.0485e-02, PNorm = 521.7117, GNorm = 0.4362, lr_0 = 9.9351e-04
Validation auc = 0.718385
Epoch 9210
Loss = 8.7121e-03, PNorm = 521.7258, GNorm = 0.1491, lr_0 = 9.9351e-04
Validation auc = 0.720929
Epoch 9211
Loss = 3.1371e-02, PNorm = 521.7406, GNorm = 0.1045, lr_0 = 9.9351e-04
Validation auc = 0.716206
Epoch 9212
Loss = 7.7122e-03, PNorm = 521.7544, GNorm = 1.3780, lr_0 = 9.9350e-04
Validation auc = 0.712476
Epoch 9213
Loss = 4.1099e-02, PNorm = 521.7683, GNorm = 0.0213, lr_0 = 9.9350e-04
Validation auc = 0.718603
Epoch 9214
Loss = 4.1268e-02, PNorm = 521.7862, GNorm = 1.8595, lr_0 = 9.9350e-04
Validation auc = 0.722917
Epoch 9215
Loss = 3.4746e-03, PNorm = 521.8057, GNorm = 0.0820, lr_0 = 9.9350e-04
Validation auc = 0.715041
Epoch 9216
Loss = 6.5427e-03, PNorm = 521.8262, GNorm = 0.0984, lr_0 = 9.9350e-04
Validation auc = 0.710925
Epoch 9217
Loss = 2.6881e-02, PNorm = 521.8452, GNorm = 0.1700, lr_0 = 9.9350e-04
Validation auc = 0.709882
Epoch 9218
Loss = 4.8262e-02, PNorm = 521.8658, GNorm = 1.2916, lr_0 = 9.9350e-04
Validation auc = 0.710195
Epoch 9219
Loss = 1.3965e-02, PNorm = 521.8858, GNorm = 0.7679, lr_0 = 9.9350e-04
Loss = 1.8808e-02, PNorm = 521.9057, GNorm = 0.1573, lr_0 = 9.9350e-04
Validation auc = 0.702009
Epoch 9220
Loss = 1.5309e-02, PNorm = 521.9258, GNorm = 0.7402, lr_0 = 9.9350e-04
Validation auc = 0.710318
Epoch 9221
Loss = 1.3706e-02, PNorm = 521.9452, GNorm = 0.0330, lr_0 = 9.9350e-04
Validation auc = 0.713526
Epoch 9222
Loss = 3.1730e-02, PNorm = 521.9666, GNorm = 0.2710, lr_0 = 9.9350e-04
Validation auc = 0.702192
Epoch 9223
Loss = 2.1916e-02, PNorm = 521.9916, GNorm = 0.0798, lr_0 = 9.9350e-04
Validation auc = 0.708823
Epoch 9224
Loss = 2.2717e-02, PNorm = 522.0143, GNorm = 0.3151, lr_0 = 9.9350e-04
Validation auc = 0.713791
Epoch 9225
Loss = 3.1646e-02, PNorm = 522.0357, GNorm = 0.0605, lr_0 = 9.9349e-04
Validation auc = 0.707033
Epoch 9226
Loss = 1.3594e-02, PNorm = 522.0677, GNorm = 0.7864, lr_0 = 9.9349e-04
Validation auc = 0.708460
Epoch 9227
Loss = 1.6982e-02, PNorm = 522.0956, GNorm = 0.9962, lr_0 = 9.9349e-04
Validation auc = 0.711511
Epoch 9228
Loss = 4.0706e-03, PNorm = 522.1168, GNorm = 0.0872, lr_0 = 9.9349e-04
Validation auc = 0.704141
Epoch 9229
Loss = 4.4944e-03, PNorm = 522.1411, GNorm = 0.1291, lr_0 = 9.9349e-04
Loss = 2.2361e-02, PNorm = 522.1619, GNorm = 3.1298, lr_0 = 9.9349e-04
Validation auc = 0.700961
Epoch 9230
Loss = 2.5140e-02, PNorm = 522.1832, GNorm = 0.0631, lr_0 = 9.9349e-04
Validation auc = 0.700615
Epoch 9231
Loss = 2.0278e-02, PNorm = 522.2018, GNorm = 4.7756, lr_0 = 9.9349e-04
Validation auc = 0.703970
Epoch 9232
Loss = 3.6428e-02, PNorm = 522.2299, GNorm = 0.2422, lr_0 = 9.9349e-04
Validation auc = 0.703801
Epoch 9233
Loss = 3.5573e-02, PNorm = 522.2643, GNorm = 0.1522, lr_0 = 9.9349e-04
Validation auc = 0.698092
Epoch 9234
Loss = 2.6516e-02, PNorm = 522.2986, GNorm = 0.9776, lr_0 = 9.9349e-04
Validation auc = 0.697270
Epoch 9235
Loss = 2.6352e-02, PNorm = 522.3273, GNorm = 0.4637, lr_0 = 9.9349e-04
Validation auc = 0.700806
Epoch 9236
Loss = 7.3935e-02, PNorm = 522.3564, GNorm = 5.1046, lr_0 = 9.9349e-04
Validation auc = 0.708703
Epoch 9237
Loss = 5.9754e-03, PNorm = 522.3956, GNorm = 0.9200, lr_0 = 9.9349e-04
Validation auc = 0.711582
Epoch 9238
Loss = 2.3273e-02, PNorm = 522.4333, GNorm = 0.3874, lr_0 = 9.9349e-04
Validation auc = 0.708690
Epoch 9239
Loss = 3.7165e-03, PNorm = 522.4626, GNorm = 0.1237, lr_0 = 9.9348e-04
Loss = 5.2048e-03, PNorm = 522.4811, GNorm = 0.3188, lr_0 = 9.9348e-04
Validation auc = 0.708824
Epoch 9240
Loss = 2.1673e-02, PNorm = 522.4982, GNorm = 0.2696, lr_0 = 9.9348e-04
Validation auc = 0.712110
Epoch 9241
Loss = 3.8826e-03, PNorm = 522.5193, GNorm = 0.3834, lr_0 = 9.9348e-04
Validation auc = 0.711991
Epoch 9242
Loss = 6.5612e-02, PNorm = 522.5397, GNorm = 3.8945, lr_0 = 9.9348e-04
Validation auc = 0.712841
Epoch 9243
Loss = 2.5525e-02, PNorm = 522.5641, GNorm = 0.1472, lr_0 = 9.9348e-04
Validation auc = 0.704248
Epoch 9244
Loss = 1.8884e-02, PNorm = 522.5931, GNorm = 0.2917, lr_0 = 9.9348e-04
Validation auc = 0.703676
Epoch 9245
Loss = 3.0133e-03, PNorm = 522.6267, GNorm = 0.0755, lr_0 = 9.9348e-04
Validation auc = 0.706234
Epoch 9246
Loss = 4.2490e-02, PNorm = 522.6475, GNorm = 0.7336, lr_0 = 9.9348e-04
Validation auc = 0.710137
Epoch 9247
Loss = 4.0976e-03, PNorm = 522.6714, GNorm = 0.0565, lr_0 = 9.9348e-04
Validation auc = 0.713420
Epoch 9248
Loss = 1.4571e-02, PNorm = 522.6924, GNorm = 2.7870, lr_0 = 9.9348e-04
Validation auc = 0.704843
Epoch 9249
Loss = 3.6399e-02, PNorm = 522.7178, GNorm = 2.3146, lr_0 = 9.9348e-04
Loss = 9.1570e-03, PNorm = 522.7513, GNorm = 1.1860, lr_0 = 9.9348e-04
Validation auc = 0.700945
Epoch 9250
Loss = 2.2783e-02, PNorm = 522.7796, GNorm = 0.9949, lr_0 = 9.9348e-04
Validation auc = 0.691720
Epoch 9251
Loss = 4.2162e-02, PNorm = 522.8079, GNorm = 0.0381, lr_0 = 9.9348e-04
Validation auc = 0.704050
Epoch 9252
Loss = 1.3707e-02, PNorm = 522.8365, GNorm = 0.0504, lr_0 = 9.9347e-04
Validation auc = 0.708457
Epoch 9253
Loss = 5.4462e-02, PNorm = 522.8591, GNorm = 0.2892, lr_0 = 9.9347e-04
Validation auc = 0.711092
Epoch 9254
Loss = 5.9198e-02, PNorm = 522.8858, GNorm = 2.5309, lr_0 = 9.9347e-04
Validation auc = 0.718401
Epoch 9255
Loss = 3.0900e-02, PNorm = 522.9164, GNorm = 0.8791, lr_0 = 9.9347e-04
Validation auc = 0.716709
Epoch 9256
Loss = 2.1864e-02, PNorm = 522.9405, GNorm = 1.3645, lr_0 = 9.9347e-04
Validation auc = 0.716424
Epoch 9257
Loss = 3.2691e-03, PNorm = 522.9700, GNorm = 0.0557, lr_0 = 9.9347e-04
Validation auc = 0.718673
Epoch 9258
Loss = 2.2474e-02, PNorm = 522.9991, GNorm = 0.1468, lr_0 = 9.9347e-04
Validation auc = 0.717160
Epoch 9259
Loss = 3.7325e-03, PNorm = 523.0241, GNorm = 0.1333, lr_0 = 9.9347e-04
Loss = 9.0569e-03, PNorm = 523.0432, GNorm = 0.5236, lr_0 = 9.9347e-04
Validation auc = 0.711981
Epoch 9260
Loss = 1.7526e-02, PNorm = 523.0645, GNorm = 0.4770, lr_0 = 9.9347e-04
Validation auc = 0.714361
Epoch 9261
Loss = 2.7545e-02, PNorm = 523.0850, GNorm = 0.6115, lr_0 = 9.9347e-04
Validation auc = 0.708404
Epoch 9262
Loss = 1.1031e-02, PNorm = 523.1129, GNorm = 0.1828, lr_0 = 9.9347e-04
Validation auc = 0.710138
Epoch 9263
Loss = 2.1424e-02, PNorm = 523.1378, GNorm = 0.8724, lr_0 = 9.9347e-04
Validation auc = 0.709639
Epoch 9264
Loss = 9.8602e-02, PNorm = 523.1610, GNorm = 0.1019, lr_0 = 9.9347e-04
Validation auc = 0.707757
Epoch 9265
Loss = 2.3803e-02, PNorm = 523.1969, GNorm = 0.5592, lr_0 = 9.9346e-04
Validation auc = 0.712463
Epoch 9266
Loss = 3.2441e-02, PNorm = 523.2335, GNorm = 0.5390, lr_0 = 9.9346e-04
Validation auc = 0.706445
Epoch 9267
Loss = 1.0519e-01, PNorm = 523.2968, GNorm = 0.8043, lr_0 = 9.9346e-04
Validation auc = 0.700686
Epoch 9268
Loss = 2.9621e-02, PNorm = 523.3664, GNorm = 3.1169, lr_0 = 9.9346e-04
Validation auc = 0.703934
Epoch 9269
Loss = 2.8005e-02, PNorm = 523.4132, GNorm = 1.6952, lr_0 = 9.9346e-04
Loss = 3.7890e-02, PNorm = 523.4441, GNorm = 0.1672, lr_0 = 9.9346e-04
Validation auc = 0.697150
Epoch 9270
Loss = 2.0519e-02, PNorm = 523.4711, GNorm = 0.0452, lr_0 = 9.9346e-04
Validation auc = 0.690026
Epoch 9271
Loss = 2.2881e-02, PNorm = 523.5004, GNorm = 0.7303, lr_0 = 9.9346e-04
Validation auc = 0.691817
Epoch 9272
Loss = 2.5600e-02, PNorm = 523.5399, GNorm = 0.5205, lr_0 = 9.9346e-04
Validation auc = 0.698418
Epoch 9273
Loss = 1.6305e-02, PNorm = 523.5785, GNorm = 0.3390, lr_0 = 9.9346e-04
Validation auc = 0.701107
Epoch 9274
Loss = 5.2211e-02, PNorm = 523.6075, GNorm = 0.0836, lr_0 = 9.9346e-04
Validation auc = 0.689637
Epoch 9275
Loss = 5.6426e-03, PNorm = 523.6362, GNorm = 0.2595, lr_0 = 9.9346e-04
Validation auc = 0.691873
Epoch 9276
Loss = 3.8737e-02, PNorm = 523.6661, GNorm = 2.3358, lr_0 = 9.9346e-04
Validation auc = 0.699573
Epoch 9277
Loss = 2.9802e-02, PNorm = 523.6965, GNorm = 1.7312, lr_0 = 9.9346e-04
Validation auc = 0.700900
Epoch 9278
Loss = 1.7406e-02, PNorm = 523.7268, GNorm = 1.5581, lr_0 = 9.9346e-04
Validation auc = 0.696766
Epoch 9279
Loss = 2.0444e-02, PNorm = 523.7514, GNorm = 0.9588, lr_0 = 9.9345e-04
Loss = 4.3593e-02, PNorm = 523.7806, GNorm = 3.5155, lr_0 = 9.9345e-04
Validation auc = 0.687371
Epoch 9280
Loss = 9.9679e-03, PNorm = 523.8103, GNorm = 0.2792, lr_0 = 9.9345e-04
Validation auc = 0.690035
Epoch 9281
Loss = 1.1171e-01, PNorm = 523.8508, GNorm = 0.2210, lr_0 = 9.9345e-04
Validation auc = 0.688999
Epoch 9282
Loss = 4.8388e-02, PNorm = 523.9062, GNorm = 1.6147, lr_0 = 9.9345e-04
Validation auc = 0.689467
Epoch 9283
Loss = 1.6292e-02, PNorm = 523.9544, GNorm = 1.1815, lr_0 = 9.9345e-04
Validation auc = 0.688090
Epoch 9284
Loss = 2.8327e-02, PNorm = 523.9932, GNorm = 1.6193, lr_0 = 9.9345e-04
Validation auc = 0.679673
Epoch 9285
Loss = 2.1213e-02, PNorm = 524.0357, GNorm = 0.3402, lr_0 = 9.9345e-04
Validation auc = 0.674938
Epoch 9286
Loss = 2.0555e-02, PNorm = 524.0766, GNorm = 1.1869, lr_0 = 9.9345e-04
Validation auc = 0.673650
Epoch 9287
Loss = 9.2823e-03, PNorm = 524.1137, GNorm = 0.7211, lr_0 = 9.9345e-04
Validation auc = 0.683297
Epoch 9288
Loss = 1.3816e-02, PNorm = 524.1403, GNorm = 2.6397, lr_0 = 9.9345e-04
Validation auc = 0.678712
Epoch 9289
Loss = 2.0079e-02, PNorm = 524.1662, GNorm = 1.3875, lr_0 = 9.9345e-04
Loss = 8.3806e-03, PNorm = 524.1920, GNorm = 0.2033, lr_0 = 9.9345e-04
Validation auc = 0.682098
Epoch 9290
Loss = 7.6982e-02, PNorm = 524.2131, GNorm = 0.5060, lr_0 = 9.9345e-04
Validation auc = 0.687469
Epoch 9291
Loss = 1.8836e-02, PNorm = 524.2362, GNorm = 1.8573, lr_0 = 9.9344e-04
Validation auc = 0.689005
Epoch 9292
Loss = 1.9814e-02, PNorm = 524.2585, GNorm = 1.4712, lr_0 = 9.9344e-04
Validation auc = 0.689830
Epoch 9293
Loss = 3.9343e-02, PNorm = 524.2854, GNorm = 0.1230, lr_0 = 9.9344e-04
Validation auc = 0.685421
Epoch 9294
Loss = 3.9687e-02, PNorm = 524.3145, GNorm = 0.1014, lr_0 = 9.9344e-04
Validation auc = 0.688494
Epoch 9295
Loss = 2.7519e-02, PNorm = 524.3374, GNorm = 0.1708, lr_0 = 9.9344e-04
Validation auc = 0.684640
Epoch 9296
Loss = 3.8734e-02, PNorm = 524.3586, GNorm = 4.0949, lr_0 = 9.9344e-04
Validation auc = 0.694316
Epoch 9297
Loss = 5.1151e-02, PNorm = 524.3877, GNorm = 1.7626, lr_0 = 9.9344e-04
Validation auc = 0.699466
Epoch 9298
Loss = 9.8603e-03, PNorm = 524.4174, GNorm = 0.5961, lr_0 = 9.9344e-04
Validation auc = 0.700603
Epoch 9299
Loss = 3.5472e-02, PNorm = 524.4445, GNorm = 2.1319, lr_0 = 9.9344e-04
Loss = 1.6854e-02, PNorm = 524.4700, GNorm = 1.6496, lr_0 = 9.9344e-04
Validation auc = 0.700633
Epoch 9300
Loss = 1.0087e-02, PNorm = 524.4904, GNorm = 0.7228, lr_0 = 9.9344e-04
Validation auc = 0.705127
Epoch 9301
Loss = 1.0812e-02, PNorm = 524.5059, GNorm = 2.5286, lr_0 = 9.9344e-04
Validation auc = 0.707576
Epoch 9302
Loss = 2.2524e-02, PNorm = 524.5229, GNorm = 3.2602, lr_0 = 9.9344e-04
Validation auc = 0.705784
Epoch 9303
Loss = 1.0074e-02, PNorm = 524.5556, GNorm = 0.4401, lr_0 = 9.9344e-04
Validation auc = 0.699037
Epoch 9304
Loss = 1.3083e-02, PNorm = 524.5843, GNorm = 0.0294, lr_0 = 9.9344e-04
Validation auc = 0.694771
Epoch 9305
Loss = 8.5939e-02, PNorm = 524.6159, GNorm = 3.8086, lr_0 = 9.9343e-04
Validation auc = 0.686820
Epoch 9306
Loss = 2.5580e-02, PNorm = 524.6480, GNorm = 0.1230, lr_0 = 9.9343e-04
Validation auc = 0.685867
Epoch 9307
Loss = 1.8565e-03, PNorm = 524.6723, GNorm = 0.1928, lr_0 = 9.9343e-04
Validation auc = 0.689239
Epoch 9308
Loss = 3.6328e-02, PNorm = 524.6942, GNorm = 0.4806, lr_0 = 9.9343e-04
Validation auc = 0.696315
Epoch 9309
Loss = 1.8490e-01, PNorm = 524.7220, GNorm = 5.8746, lr_0 = 9.9343e-04
Loss = 1.7449e-02, PNorm = 524.7518, GNorm = 0.5213, lr_0 = 9.9343e-04
Validation auc = 0.690748
Epoch 9310
Loss = 3.0737e-02, PNorm = 524.7860, GNorm = 1.2017, lr_0 = 9.9343e-04
Validation auc = 0.693666
Epoch 9311
Loss = 5.8739e-02, PNorm = 524.8215, GNorm = 7.9289, lr_0 = 9.9343e-04
Validation auc = 0.699414
Epoch 9312
Loss = 1.7010e-02, PNorm = 524.8614, GNorm = 0.4792, lr_0 = 9.9343e-04
Validation auc = 0.700458
Epoch 9313
Loss = 2.8292e-02, PNorm = 524.8987, GNorm = 0.2941, lr_0 = 9.9343e-04
Validation auc = 0.702742
Epoch 9314
Loss = 2.8639e-02, PNorm = 524.9294, GNorm = 2.3805, lr_0 = 9.9343e-04
Validation auc = 0.700422
Epoch 9315
Loss = 7.6724e-02, PNorm = 524.9481, GNorm = 1.8634, lr_0 = 9.9343e-04
Validation auc = 0.698161
Epoch 9316
Loss = 3.2296e-02, PNorm = 524.9784, GNorm = 0.3833, lr_0 = 9.9343e-04
Validation auc = 0.708176
Epoch 9317
Loss = 2.1796e-02, PNorm = 525.0172, GNorm = 1.3279, lr_0 = 9.9343e-04
Validation auc = 0.709157
Epoch 9318
Loss = 4.4713e-03, PNorm = 525.0429, GNorm = 0.1093, lr_0 = 9.9343e-04
Validation auc = 0.708766
Epoch 9319
Loss = 1.3186e-02, PNorm = 525.0624, GNorm = 0.7072, lr_0 = 9.9342e-04
Loss = 2.9521e-02, PNorm = 525.0824, GNorm = 0.3574, lr_0 = 9.9342e-04
Validation auc = 0.706872
Epoch 9320
Loss = 3.8146e-02, PNorm = 525.1016, GNorm = 0.1176, lr_0 = 9.9342e-04
Validation auc = 0.707407
Epoch 9321
Loss = 1.7517e-02, PNorm = 525.1280, GNorm = 1.3936, lr_0 = 9.9342e-04
Validation auc = 0.708507
Epoch 9322
Loss = 2.7349e-02, PNorm = 525.1513, GNorm = 0.4572, lr_0 = 9.9342e-04
Validation auc = 0.708184
Epoch 9323
Loss = 1.5791e-02, PNorm = 525.1748, GNorm = 0.0533, lr_0 = 9.9342e-04
Validation auc = 0.705722
Epoch 9324
Loss = 2.8642e-02, PNorm = 525.1950, GNorm = 0.0501, lr_0 = 9.9342e-04
Validation auc = 0.702801
Epoch 9325
Loss = 1.0775e-02, PNorm = 525.2157, GNorm = 0.8023, lr_0 = 9.9342e-04
Validation auc = 0.708256
Epoch 9326
Loss = 1.4326e-02, PNorm = 525.2369, GNorm = 0.1013, lr_0 = 9.9342e-04
Validation auc = 0.711892
Epoch 9327
Loss = 7.0608e-04, PNorm = 525.2591, GNorm = 0.0150, lr_0 = 9.9342e-04
Validation auc = 0.709087
Epoch 9328
Loss = 2.6533e-03, PNorm = 525.2813, GNorm = 0.1961, lr_0 = 9.9342e-04
Validation auc = 0.707837
Epoch 9329
Loss = 1.6482e-02, PNorm = 525.3116, GNorm = 1.6197, lr_0 = 9.9342e-04
Loss = 5.8666e-03, PNorm = 525.3463, GNorm = 0.0857, lr_0 = 9.9342e-04
Validation auc = 0.705500
Epoch 9330
Loss = 1.7156e-02, PNorm = 525.3673, GNorm = 0.4031, lr_0 = 9.9342e-04
Validation auc = 0.705966
Epoch 9331
Loss = 5.9381e-03, PNorm = 525.3833, GNorm = 0.4061, lr_0 = 9.9341e-04
Validation auc = 0.709465
Epoch 9332
Loss = 2.2517e-02, PNorm = 525.4000, GNorm = 0.0602, lr_0 = 9.9341e-04
Validation auc = 0.713649
Epoch 9333
Loss = 2.0180e-02, PNorm = 525.4307, GNorm = 0.1404, lr_0 = 9.9341e-04
Validation auc = 0.704907
Epoch 9334
Loss = 2.3141e-02, PNorm = 525.4615, GNorm = 2.7766, lr_0 = 9.9341e-04
Validation auc = 0.697545
Epoch 9335
Loss = 2.7520e-02, PNorm = 525.5008, GNorm = 0.1077, lr_0 = 9.9341e-04
Validation auc = 0.694371
Epoch 9336
Loss = 1.2407e-02, PNorm = 525.5372, GNorm = 0.2989, lr_0 = 9.9341e-04
Validation auc = 0.692167
Epoch 9337
Loss = 3.2441e-02, PNorm = 525.5647, GNorm = 0.6059, lr_0 = 9.9341e-04
Validation auc = 0.695268
Epoch 9338
Loss = 1.8752e-02, PNorm = 525.5919, GNorm = 1.0746, lr_0 = 9.9341e-04
Validation auc = 0.701141
Epoch 9339
Loss = 2.8582e-04, PNorm = 525.6158, GNorm = 0.0183, lr_0 = 9.9341e-04
Loss = 5.3385e-02, PNorm = 525.6390, GNorm = 6.7329, lr_0 = 9.9341e-04
Validation auc = 0.701466
Epoch 9340
Loss = 5.0943e-02, PNorm = 525.6738, GNorm = 1.2927, lr_0 = 9.9341e-04
Validation auc = 0.702830
Epoch 9341
Loss = 1.8144e-02, PNorm = 525.7090, GNorm = 1.1215, lr_0 = 9.9341e-04
Validation auc = 0.706344
Epoch 9342
Loss = 3.5424e-01, PNorm = 525.7582, GNorm = 0.4083, lr_0 = 9.9341e-04
Validation auc = 0.716744
Epoch 9343
Loss = 4.0378e-02, PNorm = 525.8400, GNorm = 0.2006, lr_0 = 9.9341e-04
Validation auc = 0.714012
Epoch 9344
Loss = 3.9119e-02, PNorm = 525.9032, GNorm = 0.9431, lr_0 = 9.9341e-04
Validation auc = 0.710507
Epoch 9345
Loss = 3.2530e-02, PNorm = 525.9507, GNorm = 1.2430, lr_0 = 9.9340e-04
Validation auc = 0.705821
Epoch 9346
Loss = 6.8732e-02, PNorm = 525.9867, GNorm = 1.7468, lr_0 = 9.9340e-04
Validation auc = 0.701914
Epoch 9347
Loss = 6.0268e-02, PNorm = 526.0328, GNorm = 6.1451, lr_0 = 9.9340e-04
Validation auc = 0.700026
Epoch 9348
Loss = 1.5282e-02, PNorm = 526.0904, GNorm = 1.9282, lr_0 = 9.9340e-04
Validation auc = 0.703908
Epoch 9349
Loss = 1.2361e-02, PNorm = 526.1469, GNorm = 0.6398, lr_0 = 9.9340e-04
Loss = 6.0624e-02, PNorm = 526.1880, GNorm = 0.9066, lr_0 = 9.9340e-04
Validation auc = 0.700825
Epoch 9350
Loss = 2.4629e-02, PNorm = 526.2176, GNorm = 0.5246, lr_0 = 9.9340e-04
Validation auc = 0.703497
Epoch 9351
Loss = 1.7077e-02, PNorm = 526.2455, GNorm = 1.2613, lr_0 = 9.9340e-04
Validation auc = 0.705855
Epoch 9352
Loss = 3.5850e-02, PNorm = 526.2723, GNorm = 3.4274, lr_0 = 9.9340e-04
Validation auc = 0.697598
Epoch 9353
Loss = 6.9497e-02, PNorm = 526.2991, GNorm = 1.7709, lr_0 = 9.9340e-04
Validation auc = 0.695039
Epoch 9354
Loss = 7.3430e-02, PNorm = 526.3339, GNorm = 0.0683, lr_0 = 9.9340e-04
Validation auc = 0.696646
Epoch 9355
Loss = 6.8418e-02, PNorm = 526.3667, GNorm = 2.2286, lr_0 = 9.9340e-04
Validation auc = 0.693606
Epoch 9356
Loss = 1.0739e-02, PNorm = 526.3969, GNorm = 0.1081, lr_0 = 9.9340e-04
Validation auc = 0.687123
Epoch 9357
Loss = 2.1812e-02, PNorm = 526.4208, GNorm = 0.3973, lr_0 = 9.9340e-04
Validation auc = 0.688628
Epoch 9358
Loss = 3.3611e-02, PNorm = 526.4392, GNorm = 0.1428, lr_0 = 9.9339e-04
Validation auc = 0.697224
Epoch 9359
Loss = 6.4732e-03, PNorm = 526.4612, GNorm = 0.3762, lr_0 = 9.9339e-04
Loss = 6.2807e-02, PNorm = 526.4864, GNorm = 0.0960, lr_0 = 9.9339e-04
Validation auc = 0.701273
Epoch 9360
Loss = 1.8941e-02, PNorm = 526.5125, GNorm = 0.2477, lr_0 = 9.9339e-04
Validation auc = 0.705611
Epoch 9361
Loss = 2.1900e-02, PNorm = 526.5323, GNorm = 0.6691, lr_0 = 9.9339e-04
Validation auc = 0.708070
Epoch 9362
Loss = 6.6185e-02, PNorm = 526.5590, GNorm = 1.5635, lr_0 = 9.9339e-04
Validation auc = 0.719309
Epoch 9363
Loss = 1.5635e-02, PNorm = 526.5916, GNorm = 1.4301, lr_0 = 9.9339e-04
Validation auc = 0.722766
Epoch 9364
Loss = 2.1842e-02, PNorm = 526.6172, GNorm = 0.9028, lr_0 = 9.9339e-04
Validation auc = 0.722605
Epoch 9365
Loss = 8.8211e-03, PNorm = 526.6361, GNorm = 0.1279, lr_0 = 9.9339e-04
Validation auc = 0.721771
Epoch 9366
Loss = 2.9803e-02, PNorm = 526.6538, GNorm = 0.0983, lr_0 = 9.9339e-04
Validation auc = 0.723263
Epoch 9367
Loss = 2.7525e-03, PNorm = 526.6699, GNorm = 0.2298, lr_0 = 9.9339e-04
Validation auc = 0.721717
Epoch 9368
Loss = 2.6877e-02, PNorm = 526.6855, GNorm = 0.1387, lr_0 = 9.9339e-04
Validation auc = 0.721149
Epoch 9369
Loss = 2.6213e-02, PNorm = 526.7119, GNorm = 1.3501, lr_0 = 9.9339e-04
Loss = 1.6619e-02, PNorm = 526.7405, GNorm = 0.9136, lr_0 = 9.9339e-04
Validation auc = 0.719680
Epoch 9370
Loss = 5.3365e-03, PNorm = 526.7591, GNorm = 0.2609, lr_0 = 9.9339e-04
Validation auc = 0.720779
Epoch 9371
Loss = 1.0074e-02, PNorm = 526.7740, GNorm = 0.1473, lr_0 = 9.9338e-04
Validation auc = 0.720556
Epoch 9372
Loss = 5.0502e-03, PNorm = 526.7896, GNorm = 0.3562, lr_0 = 9.9338e-04
Validation auc = 0.718370
Epoch 9373
Loss = 4.8250e-03, PNorm = 526.8016, GNorm = 0.2674, lr_0 = 9.9338e-04
Validation auc = 0.717451
Epoch 9374
Loss = 5.8785e-03, PNorm = 526.8168, GNorm = 1.5251, lr_0 = 9.9338e-04
Validation auc = 0.716952
Epoch 9375
Loss = 4.3074e-03, PNorm = 526.8313, GNorm = 0.0557, lr_0 = 9.9338e-04
Validation auc = 0.715304
Epoch 9376
Loss = 2.8488e-03, PNorm = 526.8401, GNorm = 0.0417, lr_0 = 9.9338e-04
Validation auc = 0.712874
Epoch 9377
Loss = 4.1364e-02, PNorm = 526.8483, GNorm = 0.2554, lr_0 = 9.9338e-04
Validation auc = 0.706065
Epoch 9378
Loss = 1.3347e-02, PNorm = 526.8623, GNorm = 1.0580, lr_0 = 9.9338e-04
Validation auc = 0.696968
Epoch 9379
Loss = 3.5684e-02, PNorm = 526.8775, GNorm = 2.2645, lr_0 = 9.9338e-04
Loss = 1.4899e-02, PNorm = 526.8957, GNorm = 0.1535, lr_0 = 9.9338e-04
Validation auc = 0.695372
Epoch 9380
Loss = 1.7883e-02, PNorm = 526.9112, GNorm = 1.7623, lr_0 = 9.9338e-04
Validation auc = 0.695467
Epoch 9381
Loss = 9.6241e-03, PNorm = 526.9289, GNorm = 1.0075, lr_0 = 9.9338e-04
Validation auc = 0.690544
Epoch 9382
Loss = 3.6312e-02, PNorm = 526.9469, GNorm = 0.4316, lr_0 = 9.9338e-04
Validation auc = 0.698949
Epoch 9383
Loss = 1.6632e-02, PNorm = 526.9679, GNorm = 0.6649, lr_0 = 9.9338e-04
Validation auc = 0.703695
Epoch 9384
Loss = 9.2637e-03, PNorm = 526.9882, GNorm = 0.0819, lr_0 = 9.9338e-04
Validation auc = 0.706167
Epoch 9385
Loss = 3.5102e-02, PNorm = 527.0028, GNorm = 0.0801, lr_0 = 9.9337e-04
Validation auc = 0.705380
Epoch 9386
Loss = 1.5466e-02, PNorm = 527.0142, GNorm = 0.2368, lr_0 = 9.9337e-04
Validation auc = 0.700324
Epoch 9387
Loss = 3.0233e-03, PNorm = 527.0286, GNorm = 0.3321, lr_0 = 9.9337e-04
Validation auc = 0.699925
Epoch 9388
Loss = 1.7620e-02, PNorm = 527.0475, GNorm = 0.8354, lr_0 = 9.9337e-04
Validation auc = 0.698351
Epoch 9389
Loss = 7.4114e-04, PNorm = 527.0661, GNorm = 0.0434, lr_0 = 9.9337e-04
Loss = 2.0278e-02, PNorm = 527.0877, GNorm = 0.4719, lr_0 = 9.9337e-04
Validation auc = 0.694359
Epoch 9390
Loss = 2.8737e-02, PNorm = 527.1167, GNorm = 0.0265, lr_0 = 9.9337e-04
Validation auc = 0.705255
Epoch 9391
Loss = 1.4662e-02, PNorm = 527.1388, GNorm = 0.6721, lr_0 = 9.9337e-04
Validation auc = 0.710472
Epoch 9392
Loss = 2.1227e-02, PNorm = 527.1576, GNorm = 0.9204, lr_0 = 9.9337e-04
Validation auc = 0.716141
Epoch 9393
Loss = 3.8152e-02, PNorm = 527.1850, GNorm = 1.1271, lr_0 = 9.9337e-04
Validation auc = 0.721468
Epoch 9394
Loss = 3.4711e-02, PNorm = 527.2076, GNorm = 3.3808, lr_0 = 9.9337e-04
Validation auc = 0.723972
Epoch 9395
Loss = 9.8401e-03, PNorm = 527.2284, GNorm = 1.8768, lr_0 = 9.9337e-04
Validation auc = 0.722846
Epoch 9396
Loss = 1.4473e-02, PNorm = 527.2484, GNorm = 0.0575, lr_0 = 9.9337e-04
Validation auc = 0.719756
Epoch 9397
Loss = 5.2595e-03, PNorm = 527.2651, GNorm = 0.1405, lr_0 = 9.9337e-04
Validation auc = 0.717794
Epoch 9398
Loss = 5.4100e-03, PNorm = 527.2777, GNorm = 0.1428, lr_0 = 9.9336e-04
Validation auc = 0.715036
Epoch 9399
Loss = 1.2670e-03, PNorm = 527.2920, GNorm = 0.0743, lr_0 = 9.9336e-04
Loss = 2.1269e-02, PNorm = 527.3125, GNorm = 2.2328, lr_0 = 9.9336e-04
Validation auc = 0.717125
Epoch 9400
Loss = 2.0941e-02, PNorm = 527.3360, GNorm = 0.6495, lr_0 = 9.9336e-04
Validation auc = 0.723104
Epoch 9401
Loss = 1.8047e-02, PNorm = 527.3617, GNorm = 2.0487, lr_0 = 9.9336e-04
Validation auc = 0.723621
Epoch 9402
Loss = 2.6597e-02, PNorm = 527.3891, GNorm = 0.0372, lr_0 = 9.9336e-04
Validation auc = 0.725763
Epoch 9403
Loss = 1.8499e-02, PNorm = 527.4089, GNorm = 0.4789, lr_0 = 9.9336e-04
Validation auc = 0.724494
Epoch 9404
Loss = 2.6523e-02, PNorm = 527.4250, GNorm = 0.0452, lr_0 = 9.9336e-04
Validation auc = 0.725293
Epoch 9405
Loss = 2.8078e-02, PNorm = 527.4414, GNorm = 0.1781, lr_0 = 9.9336e-04
Validation auc = 0.723917
Epoch 9406
Loss = 1.1209e-02, PNorm = 527.4586, GNorm = 0.1243, lr_0 = 9.9336e-04
Validation auc = 0.719341
Epoch 9407
Loss = 4.2090e-03, PNorm = 527.4719, GNorm = 0.3195, lr_0 = 9.9336e-04
Validation auc = 0.719449
Epoch 9408
Loss = 5.0535e-02, PNorm = 527.4858, GNorm = 0.2747, lr_0 = 9.9336e-04
Validation auc = 0.717253
Epoch 9409
Loss = 1.1832e-03, PNorm = 527.5093, GNorm = 0.0604, lr_0 = 9.9336e-04
Loss = 1.2372e-02, PNorm = 527.5333, GNorm = 0.5427, lr_0 = 9.9336e-04
Validation auc = 0.721120
Epoch 9410
Loss = 6.4432e-03, PNorm = 527.5501, GNorm = 0.3646, lr_0 = 9.9336e-04
Validation auc = 0.722403
Epoch 9411
Loss = 2.2734e-02, PNorm = 527.5641, GNorm = 0.0309, lr_0 = 9.9335e-04
Validation auc = 0.720978
Epoch 9412
Loss = 3.8302e-02, PNorm = 527.5798, GNorm = 0.8155, lr_0 = 9.9335e-04
Validation auc = 0.720376
Epoch 9413
Loss = 7.0825e-03, PNorm = 527.5944, GNorm = 1.0580, lr_0 = 9.9335e-04
Validation auc = 0.720975
Epoch 9414
Loss = 9.0466e-03, PNorm = 527.6089, GNorm = 1.0380, lr_0 = 9.9335e-04
Validation auc = 0.720506
Epoch 9415
Loss = 1.5409e-02, PNorm = 527.6241, GNorm = 0.7446, lr_0 = 9.9335e-04
Validation auc = 0.720035
Epoch 9416
Loss = 7.8128e-03, PNorm = 527.6402, GNorm = 0.1669, lr_0 = 9.9335e-04
Validation auc = 0.716190
Epoch 9417
Loss = 1.4603e-02, PNorm = 527.6571, GNorm = 0.1880, lr_0 = 9.9335e-04
Validation auc = 0.715851
Epoch 9418
Loss = 4.1982e-03, PNorm = 527.6762, GNorm = 0.4685, lr_0 = 9.9335e-04
Validation auc = 0.715666
Epoch 9419
Loss = 8.0267e-02, PNorm = 527.6938, GNorm = 1.3904, lr_0 = 9.9335e-04
Loss = 5.9793e-02, PNorm = 527.7245, GNorm = 0.0612, lr_0 = 9.9335e-04
Validation auc = 0.714692
Epoch 9420
Loss = 6.9298e-03, PNorm = 527.7573, GNorm = 0.3774, lr_0 = 9.9335e-04
Validation auc = 0.714010
Epoch 9421
Loss = 1.5130e-02, PNorm = 527.7783, GNorm = 2.3458, lr_0 = 9.9335e-04
Validation auc = 0.714283
Epoch 9422
Loss = 3.3190e-02, PNorm = 527.7928, GNorm = 3.4707, lr_0 = 9.9335e-04
Validation auc = 0.716518
Epoch 9423
Loss = 2.5298e-02, PNorm = 527.8125, GNorm = 0.1576, lr_0 = 9.9335e-04
Validation auc = 0.720839
Epoch 9424
Loss = 3.2971e-02, PNorm = 527.8304, GNorm = 0.5533, lr_0 = 9.9335e-04
Validation auc = 0.719843
Epoch 9425
Loss = 8.3128e-02, PNorm = 527.8514, GNorm = 0.3659, lr_0 = 9.9334e-04
Validation auc = 0.714042
Epoch 9426
Loss = 8.5000e-03, PNorm = 527.8779, GNorm = 0.2455, lr_0 = 9.9334e-04
Validation auc = 0.709238
Epoch 9427
Loss = 1.4831e-03, PNorm = 527.9012, GNorm = 0.0524, lr_0 = 9.9334e-04
Validation auc = 0.710421
Epoch 9428
Loss = 5.3775e-02, PNorm = 527.9197, GNorm = 2.9917, lr_0 = 9.9334e-04
Validation auc = 0.698133
Epoch 9429
Loss = 2.8908e-02, PNorm = 527.9388, GNorm = 1.3754, lr_0 = 9.9334e-04
Loss = 1.8455e-02, PNorm = 527.9642, GNorm = 0.0637, lr_0 = 9.9334e-04
Validation auc = 0.704510
Epoch 9430
Loss = 1.0739e-02, PNorm = 527.9974, GNorm = 0.8302, lr_0 = 9.9334e-04
Validation auc = 0.713451
Epoch 9431
Loss = 2.1331e-02, PNorm = 528.0278, GNorm = 1.3682, lr_0 = 9.9334e-04
Validation auc = 0.712448
Epoch 9432
Loss = 3.5707e-03, PNorm = 528.0494, GNorm = 0.0720, lr_0 = 9.9334e-04
Validation auc = 0.708591
Epoch 9433
Loss = 9.9666e-03, PNorm = 528.0692, GNorm = 0.0277, lr_0 = 9.9334e-04
Validation auc = 0.715357
Epoch 9434
Loss = 2.4261e-02, PNorm = 528.0886, GNorm = 2.6787, lr_0 = 9.9334e-04
Validation auc = 0.714190
Epoch 9435
Loss = 1.5384e-02, PNorm = 528.1080, GNorm = 0.1710, lr_0 = 9.9334e-04
Validation auc = 0.713050
Epoch 9436
Loss = 5.5493e-03, PNorm = 528.1380, GNorm = 0.0494, lr_0 = 9.9334e-04
Validation auc = 0.719203
Epoch 9437
Loss = 5.9225e-03, PNorm = 528.1674, GNorm = 0.1930, lr_0 = 9.9334e-04
Validation auc = 0.713194
Epoch 9438
Loss = 7.5291e-02, PNorm = 528.1983, GNorm = 0.1371, lr_0 = 9.9333e-04
Validation auc = 0.715180
Epoch 9439
Loss = 2.2216e-02, PNorm = 528.2397, GNorm = 0.5978, lr_0 = 9.9333e-04
Loss = 4.0110e-02, PNorm = 528.2833, GNorm = 1.4861, lr_0 = 9.9333e-04
Validation auc = 0.721575
Epoch 9440
Loss = 2.6814e-02, PNorm = 528.3174, GNorm = 0.1609, lr_0 = 9.9333e-04
Validation auc = 0.714448
Epoch 9441
Loss = 2.8333e-02, PNorm = 528.3412, GNorm = 0.1997, lr_0 = 9.9333e-04
Validation auc = 0.713440
Epoch 9442
Loss = 3.2862e-02, PNorm = 528.3595, GNorm = 0.7820, lr_0 = 9.9333e-04
Validation auc = 0.713836
Epoch 9443
Loss = 2.5457e-02, PNorm = 528.3776, GNorm = 1.7572, lr_0 = 9.9333e-04
Validation auc = 0.712337
Epoch 9444
Loss = 7.5551e-03, PNorm = 528.3987, GNorm = 0.0757, lr_0 = 9.9333e-04
Validation auc = 0.699350
Epoch 9445
Loss = 3.0247e-02, PNorm = 528.4178, GNorm = 2.0595, lr_0 = 9.9333e-04
Validation auc = 0.703878
Epoch 9446
Loss = 3.1330e-03, PNorm = 528.4465, GNorm = 0.1224, lr_0 = 9.9333e-04
Validation auc = 0.703834
Epoch 9447
Loss = 2.0201e-02, PNorm = 528.4677, GNorm = 1.3270, lr_0 = 9.9333e-04
Validation auc = 0.700867
Epoch 9448
Loss = 1.0934e-02, PNorm = 528.4829, GNorm = 0.8280, lr_0 = 9.9333e-04
Validation auc = 0.698161
Epoch 9449
Loss = 8.5832e-03, PNorm = 528.4961, GNorm = 0.4731, lr_0 = 9.9333e-04
Loss = 1.4826e-02, PNorm = 528.5111, GNorm = 0.1060, lr_0 = 9.9333e-04
Validation auc = 0.705486
Epoch 9450
Loss = 2.8241e-02, PNorm = 528.5262, GNorm = 1.8473, lr_0 = 9.9333e-04
Validation auc = 0.705025
Epoch 9451
Loss = 9.9123e-03, PNorm = 528.5414, GNorm = 0.3289, lr_0 = 9.9332e-04
Validation auc = 0.703928
Epoch 9452
Loss = 7.6334e-03, PNorm = 528.5561, GNorm = 0.0320, lr_0 = 9.9332e-04
Validation auc = 0.703547
Epoch 9453
Loss = 2.5021e-02, PNorm = 528.5679, GNorm = 0.2625, lr_0 = 9.9332e-04
Validation auc = 0.706536
Epoch 9454
Loss = 6.4507e-02, PNorm = 528.5954, GNorm = 0.2148, lr_0 = 9.9332e-04
Validation auc = 0.700959
Epoch 9455
Loss = 1.5320e-03, PNorm = 528.6245, GNorm = 0.0773, lr_0 = 9.9332e-04
Validation auc = 0.700666
Epoch 9456
Loss = 1.1284e-02, PNorm = 528.6412, GNorm = 1.3054, lr_0 = 9.9332e-04
Validation auc = 0.701740
Epoch 9457
Loss = 6.3147e-03, PNorm = 528.6560, GNorm = 0.8971, lr_0 = 9.9332e-04
Validation auc = 0.693165
Epoch 9458
Loss = 3.9280e-03, PNorm = 528.6713, GNorm = 0.3272, lr_0 = 9.9332e-04
Validation auc = 0.690698
Epoch 9459
Loss = 2.7552e-03, PNorm = 528.6877, GNorm = 0.2799, lr_0 = 9.9332e-04
Loss = 4.1168e-03, PNorm = 528.7020, GNorm = 0.3982, lr_0 = 9.9332e-04
Validation auc = 0.690217
Epoch 9460
Loss = 8.8941e-03, PNorm = 528.7164, GNorm = 0.0295, lr_0 = 9.9332e-04
Validation auc = 0.684999
Epoch 9461
Loss = 2.1097e-02, PNorm = 528.7290, GNorm = 0.0896, lr_0 = 9.9332e-04
Validation auc = 0.681959
Epoch 9462
Loss = 1.1289e-03, PNorm = 528.7413, GNorm = 0.0369, lr_0 = 9.9332e-04
Validation auc = 0.684540
Epoch 9463
Loss = 1.0199e-02, PNorm = 528.7492, GNorm = 0.0378, lr_0 = 9.9332e-04
Validation auc = 0.688491
Epoch 9464
Loss = 3.0911e-03, PNorm = 528.7657, GNorm = 0.0412, lr_0 = 9.9331e-04
Validation auc = 0.693644
Epoch 9465
Loss = 5.1899e-03, PNorm = 528.7948, GNorm = 0.1971, lr_0 = 9.9331e-04
Validation auc = 0.692067
Epoch 9466
Loss = 5.9473e-02, PNorm = 528.8253, GNorm = 0.1757, lr_0 = 9.9331e-04
Validation auc = 0.693358
Epoch 9467
Loss = 3.8901e-02, PNorm = 528.8520, GNorm = 1.5453, lr_0 = 9.9331e-04
Validation auc = 0.683290
Epoch 9468
Loss = 3.9828e-02, PNorm = 528.8796, GNorm = 0.6279, lr_0 = 9.9331e-04
Validation auc = 0.680912
Epoch 9469
Loss = 4.1725e-02, PNorm = 528.9033, GNorm = 0.7827, lr_0 = 9.9331e-04
Loss = 1.2167e-02, PNorm = 528.9287, GNorm = 0.0784, lr_0 = 9.9331e-04
Validation auc = 0.684340
Epoch 9470
Loss = 1.4653e-02, PNorm = 528.9524, GNorm = 1.9516, lr_0 = 9.9331e-04
Validation auc = 0.677771
Epoch 9471
Loss = 3.6978e-03, PNorm = 528.9728, GNorm = 0.0815, lr_0 = 9.9331e-04
Validation auc = 0.671949
Epoch 9472
Loss = 1.8160e-02, PNorm = 528.9901, GNorm = 1.9236, lr_0 = 9.9331e-04
Validation auc = 0.678197
Epoch 9473
Loss = 8.1570e-03, PNorm = 529.0160, GNorm = 0.0361, lr_0 = 9.9331e-04
Validation auc = 0.678435
Epoch 9474
Loss = 1.5162e-02, PNorm = 529.0402, GNorm = 0.0234, lr_0 = 9.9331e-04
Validation auc = 0.685360
Epoch 9475
Loss = 2.3791e-03, PNorm = 529.0656, GNorm = 0.1335, lr_0 = 9.9331e-04
Validation auc = 0.697653
Epoch 9476
Loss = 7.4917e-03, PNorm = 529.0913, GNorm = 0.0714, lr_0 = 9.9331e-04
Validation auc = 0.699367
Epoch 9477
Loss = 4.7901e-03, PNorm = 529.1165, GNorm = 1.1852, lr_0 = 9.9331e-04
Validation auc = 0.702513
Epoch 9478
Loss = 2.2115e-01, PNorm = 529.1390, GNorm = 0.0237, lr_0 = 9.9330e-04
Validation auc = 0.695712
Epoch 9479
Loss = 2.0152e-01, PNorm = 529.1765, GNorm = 2.6535, lr_0 = 9.9330e-04
Loss = 4.6995e-02, PNorm = 529.2199, GNorm = 2.8492, lr_0 = 9.9330e-04
Validation auc = 0.692068
Epoch 9480
Loss = 2.0078e-02, PNorm = 529.2687, GNorm = 1.4386, lr_0 = 9.9330e-04
Validation auc = 0.693263
Epoch 9481
Loss = 2.6751e-02, PNorm = 529.3109, GNorm = 1.5522, lr_0 = 9.9330e-04
Validation auc = 0.695266
Epoch 9482
Loss = 3.7831e-02, PNorm = 529.3640, GNorm = 3.2371, lr_0 = 9.9330e-04
Validation auc = 0.703178
Epoch 9483
Loss = 2.7182e-02, PNorm = 529.4105, GNorm = 2.6830, lr_0 = 9.9330e-04
Validation auc = 0.699465
Epoch 9484
Loss = 2.6639e-02, PNorm = 529.4567, GNorm = 1.2690, lr_0 = 9.9330e-04
Validation auc = 0.695155
Epoch 9485
Loss = 5.2971e-02, PNorm = 529.4985, GNorm = 0.4462, lr_0 = 9.9330e-04
Validation auc = 0.693708
Epoch 9486
Loss = 3.0710e-02, PNorm = 529.5350, GNorm = 1.9403, lr_0 = 9.9330e-04
Validation auc = 0.694086
Epoch 9487
Loss = 1.7417e-02, PNorm = 529.5709, GNorm = 0.4230, lr_0 = 9.9330e-04
Validation auc = 0.694462
Epoch 9488
Loss = 1.5361e-02, PNorm = 529.6044, GNorm = 0.1106, lr_0 = 9.9330e-04
Validation auc = 0.688637
Epoch 9489
Loss = 4.3317e-03, PNorm = 529.6273, GNorm = 0.2886, lr_0 = 9.9330e-04
Loss = 1.9178e-02, PNorm = 529.6461, GNorm = 0.2701, lr_0 = 9.9330e-04
Validation auc = 0.683005
Epoch 9490
Loss = 2.9120e-02, PNorm = 529.6744, GNorm = 1.3003, lr_0 = 9.9330e-04
Validation auc = 0.695630
Epoch 9491
Loss = 2.3671e-02, PNorm = 529.7132, GNorm = 0.2568, lr_0 = 9.9329e-04
Validation auc = 0.705780
Epoch 9492
Loss = 1.7611e-02, PNorm = 529.7480, GNorm = 0.3711, lr_0 = 9.9329e-04
Validation auc = 0.707788
Epoch 9493
Loss = 2.7591e-02, PNorm = 529.7778, GNorm = 0.5105, lr_0 = 9.9329e-04
Validation auc = 0.713274
Epoch 9494
Loss = 5.9368e-03, PNorm = 529.8099, GNorm = 0.0337, lr_0 = 9.9329e-04
Validation auc = 0.715952
Epoch 9495
Loss = 2.7590e-02, PNorm = 529.8357, GNorm = 1.8953, lr_0 = 9.9329e-04
Validation auc = 0.708025
Epoch 9496
Loss = 1.6083e-02, PNorm = 529.8617, GNorm = 1.8816, lr_0 = 9.9329e-04
Validation auc = 0.694260
Epoch 9497
Loss = 2.7838e-02, PNorm = 529.8874, GNorm = 0.0324, lr_0 = 9.9329e-04
Validation auc = 0.696533
Epoch 9498
Loss = 6.1240e-02, PNorm = 529.9170, GNorm = 0.1229, lr_0 = 9.9329e-04
Validation auc = 0.693954
Epoch 9499
Loss = 1.6261e-03, PNorm = 529.9428, GNorm = 0.1061, lr_0 = 9.9329e-04
Loss = 2.7529e-02, PNorm = 529.9627, GNorm = 1.5888, lr_0 = 9.9329e-04
Validation auc = 0.701096
Epoch 9500
Loss = 3.9238e-02, PNorm = 529.9928, GNorm = 0.2973, lr_0 = 9.9329e-04
Validation auc = 0.693708
Epoch 9501
Loss = 2.2999e-02, PNorm = 530.0266, GNorm = 0.3842, lr_0 = 9.9329e-04
Validation auc = 0.691279
Epoch 9502
Loss = 5.5230e-03, PNorm = 530.0499, GNorm = 0.2183, lr_0 = 9.9329e-04
Validation auc = 0.698350
Epoch 9503
Loss = 2.8543e-02, PNorm = 530.0715, GNorm = 2.6221, lr_0 = 9.9329e-04
Validation auc = 0.707364
Epoch 9504
Loss = 2.0005e-02, PNorm = 530.1032, GNorm = 0.2241, lr_0 = 9.9328e-04
Validation auc = 0.702823
Epoch 9505
Loss = 1.4561e-02, PNorm = 530.1348, GNorm = 1.2704, lr_0 = 9.9328e-04
Validation auc = 0.700467
Epoch 9506
Loss = 3.6403e-03, PNorm = 530.1643, GNorm = 0.1092, lr_0 = 9.9328e-04
Validation auc = 0.707967
Epoch 9507
Loss = 2.8643e-03, PNorm = 530.1853, GNorm = 0.1852, lr_0 = 9.9328e-04
Validation auc = 0.708691
Epoch 9508
Loss = 2.8275e-02, PNorm = 530.2076, GNorm = 2.6285, lr_0 = 9.9328e-04
Validation auc = 0.698983
Epoch 9509
Loss = 2.8492e-03, PNorm = 530.2364, GNorm = 0.1464, lr_0 = 9.9328e-04
Loss = 4.0675e-03, PNorm = 530.2588, GNorm = 0.3436, lr_0 = 9.9328e-04
Validation auc = 0.691335
Epoch 9510
Loss = 3.4004e-02, PNorm = 530.2773, GNorm = 1.2776, lr_0 = 9.9328e-04
Validation auc = 0.691124
Epoch 9511
Loss = 7.9368e-03, PNorm = 530.2941, GNorm = 0.7099, lr_0 = 9.9328e-04
Validation auc = 0.691184
Epoch 9512
Loss = 5.7565e-02, PNorm = 530.3134, GNorm = 5.2093, lr_0 = 9.9328e-04
Validation auc = 0.691378
Epoch 9513
Loss = 3.2967e-02, PNorm = 530.3435, GNorm = 0.4967, lr_0 = 9.9328e-04
Validation auc = 0.693288
Epoch 9514
Loss = 8.3280e-03, PNorm = 530.3797, GNorm = 0.0280, lr_0 = 9.9328e-04
Validation auc = 0.703811
Epoch 9515
Loss = 2.6210e-02, PNorm = 530.4147, GNorm = 1.1246, lr_0 = 9.9328e-04
Validation auc = 0.703457
Epoch 9516
Loss = 2.2223e-02, PNorm = 530.4466, GNorm = 0.3159, lr_0 = 9.9328e-04
Validation auc = 0.707903
Epoch 9517
Loss = 1.1074e-02, PNorm = 530.4791, GNorm = 0.1474, lr_0 = 9.9328e-04
Validation auc = 0.714879
Epoch 9518
Loss = 2.5366e-02, PNorm = 530.5045, GNorm = 1.0340, lr_0 = 9.9327e-04
Validation auc = 0.712691
Epoch 9519
Loss = 2.8365e-03, PNorm = 530.5226, GNorm = 0.1987, lr_0 = 9.9327e-04
Loss = 6.1331e-03, PNorm = 530.5330, GNorm = 0.1168, lr_0 = 9.9327e-04
Validation auc = 0.713999
Epoch 9520
Loss = 3.7658e-02, PNorm = 530.5540, GNorm = 0.0417, lr_0 = 9.9327e-04
Validation auc = 0.715761
Epoch 9521
Loss = 4.7313e-02, PNorm = 530.5915, GNorm = 0.3804, lr_0 = 9.9327e-04
Validation auc = 0.715823
Epoch 9522
Loss = 1.6612e-02, PNorm = 530.6275, GNorm = 0.6820, lr_0 = 9.9327e-04
Validation auc = 0.713849
Epoch 9523
Loss = 1.0614e-02, PNorm = 530.6632, GNorm = 0.0205, lr_0 = 9.9327e-04
Validation auc = 0.712714
Epoch 9524
Loss = 8.4557e-02, PNorm = 530.6892, GNorm = 1.8948, lr_0 = 9.9327e-04
Validation auc = 0.718205
Epoch 9525
Loss = 2.6875e-02, PNorm = 530.7201, GNorm = 4.7605, lr_0 = 9.9327e-04
Validation auc = 0.717322
Epoch 9526
Loss = 1.4079e-02, PNorm = 530.7616, GNorm = 1.6643, lr_0 = 9.9327e-04
Validation auc = 0.714815
Epoch 9527
Loss = 3.5202e-02, PNorm = 530.7971, GNorm = 1.7208, lr_0 = 9.9327e-04
Validation auc = 0.725379
Epoch 9528
Loss = 4.4950e-02, PNorm = 530.8445, GNorm = 1.6294, lr_0 = 9.9327e-04
Validation auc = 0.729201
Epoch 9529
Loss = 6.9588e-03, PNorm = 530.8844, GNorm = 0.6017, lr_0 = 9.9327e-04
Loss = 3.5958e-02, PNorm = 530.9127, GNorm = 0.1382, lr_0 = 9.9327e-04
Validation auc = 0.715594
Epoch 9530
Loss = 4.8295e-02, PNorm = 530.9446, GNorm = 0.2256, lr_0 = 9.9327e-04
Validation auc = 0.706105
Epoch 9531
Loss = 2.4053e-02, PNorm = 530.9851, GNorm = 0.2418, lr_0 = 9.9326e-04
Validation auc = 0.702344
Epoch 9532
Loss = 3.2167e-02, PNorm = 531.0236, GNorm = 0.2805, lr_0 = 9.9326e-04
Validation auc = 0.701393
Epoch 9533
Loss = 1.6294e-02, PNorm = 531.0531, GNorm = 2.5856, lr_0 = 9.9326e-04
Validation auc = 0.705091
Epoch 9534
Loss = 1.2344e-02, PNorm = 531.0747, GNorm = 1.6504, lr_0 = 9.9326e-04
Validation auc = 0.704092
Epoch 9535
Loss = 4.5248e-02, PNorm = 531.1001, GNorm = 1.9252, lr_0 = 9.9326e-04
Validation auc = 0.709706
Epoch 9536
Loss = 6.1584e-02, PNorm = 531.1322, GNorm = 3.4643, lr_0 = 9.9326e-04
Validation auc = 0.701268
Epoch 9537
Loss = 1.6412e-03, PNorm = 531.1658, GNorm = 0.1093, lr_0 = 9.9326e-04
Validation auc = 0.708083
Epoch 9538
Loss = 1.8022e-03, PNorm = 531.1983, GNorm = 0.0764, lr_0 = 9.9326e-04
Validation auc = 0.717539
Epoch 9539
Loss = 6.5489e-03, PNorm = 531.2278, GNorm = 0.5058, lr_0 = 9.9326e-04
Loss = 4.0636e-02, PNorm = 531.2547, GNorm = 5.7934, lr_0 = 9.9326e-04
Validation auc = 0.717768
Epoch 9540
Loss = 1.8584e-02, PNorm = 531.2887, GNorm = 0.3510, lr_0 = 9.9326e-04
Validation auc = 0.727861
Epoch 9541
Loss = 1.6330e-02, PNorm = 531.3149, GNorm = 2.2977, lr_0 = 9.9326e-04
Validation auc = 0.726641
Epoch 9542
Loss = 1.1501e-02, PNorm = 531.3396, GNorm = 3.6308, lr_0 = 9.9326e-04
Validation auc = 0.718746
Epoch 9543
Loss = 8.1687e-03, PNorm = 531.3582, GNorm = 0.6514, lr_0 = 9.9326e-04
Validation auc = 0.710747
Epoch 9544
Loss = 5.7310e-02, PNorm = 531.3782, GNorm = 0.0523, lr_0 = 9.9325e-04
Validation auc = 0.710998
Epoch 9545
Loss = 3.0302e-03, PNorm = 531.4065, GNorm = 0.0250, lr_0 = 9.9325e-04
Validation auc = 0.707938
Epoch 9546
Loss = 5.6413e-03, PNorm = 531.4309, GNorm = 0.8918, lr_0 = 9.9325e-04
Validation auc = 0.711480
Epoch 9547
Loss = 3.8137e-02, PNorm = 531.4524, GNorm = 1.0291, lr_0 = 9.9325e-04
Validation auc = 0.706230
Epoch 9548
Loss = 3.3869e-03, PNorm = 531.4865, GNorm = 0.0932, lr_0 = 9.9325e-04
Validation auc = 0.702305
Epoch 9549
Loss = 1.7640e-03, PNorm = 531.5107, GNorm = 0.0975, lr_0 = 9.9325e-04
Loss = 1.7026e-02, PNorm = 531.5281, GNorm = 0.6164, lr_0 = 9.9325e-04
Validation auc = 0.702347
Epoch 9550
Loss = 4.4405e-02, PNorm = 531.5454, GNorm = 0.2098, lr_0 = 9.9325e-04
Validation auc = 0.700388
Epoch 9551
Loss = 3.5115e-02, PNorm = 531.5798, GNorm = 0.0587, lr_0 = 9.9325e-04
Validation auc = 0.691029
Epoch 9552
Loss = 9.0618e-03, PNorm = 531.6111, GNorm = 0.4153, lr_0 = 9.9325e-04
Validation auc = 0.696216
Epoch 9553
Loss = 2.5757e-02, PNorm = 531.6370, GNorm = 0.1411, lr_0 = 9.9325e-04
Validation auc = 0.702570
Epoch 9554
Loss = 1.2118e-02, PNorm = 531.6575, GNorm = 1.2298, lr_0 = 9.9325e-04
Validation auc = 0.703730
Epoch 9555
Loss = 4.4685e-03, PNorm = 531.6746, GNorm = 0.1292, lr_0 = 9.9325e-04
Validation auc = 0.705045
Epoch 9556
Loss = 2.1801e-03, PNorm = 531.6993, GNorm = 0.0758, lr_0 = 9.9325e-04
Validation auc = 0.705926
Epoch 9557
Loss = 3.7743e-02, PNorm = 531.7237, GNorm = 2.2300, lr_0 = 9.9325e-04
Validation auc = 0.704651
Epoch 9558
Loss = 3.3386e-02, PNorm = 531.7456, GNorm = 1.1002, lr_0 = 9.9324e-04
Validation auc = 0.705125
Epoch 9559
Loss = 1.8990e-02, PNorm = 531.7706, GNorm = 0.8914, lr_0 = 9.9324e-04
Loss = 3.1489e-03, PNorm = 531.7879, GNorm = 0.2860, lr_0 = 9.9324e-04
Validation auc = 0.703538
Epoch 9560
Loss = 8.6483e-03, PNorm = 531.7995, GNorm = 0.3942, lr_0 = 9.9324e-04
Validation auc = 0.699274
Epoch 9561
Loss = 3.8762e-03, PNorm = 531.8128, GNorm = 0.0751, lr_0 = 9.9324e-04
Validation auc = 0.698214
Epoch 9562
Loss = 4.5696e-02, PNorm = 531.8252, GNorm = 0.0203, lr_0 = 9.9324e-04
Validation auc = 0.696462
Epoch 9563
Loss = 1.1179e-02, PNorm = 531.8439, GNorm = 0.8273, lr_0 = 9.9324e-04
Validation auc = 0.695395
Epoch 9564
Loss = 1.7304e-02, PNorm = 531.8611, GNorm = 0.0898, lr_0 = 9.9324e-04
Validation auc = 0.693790
Epoch 9565
Loss = 3.3481e-02, PNorm = 531.8786, GNorm = 2.9925, lr_0 = 9.9324e-04
Validation auc = 0.691533
Epoch 9566
Loss = 6.3528e-02, PNorm = 531.9222, GNorm = 1.2599, lr_0 = 9.9324e-04
Validation auc = 0.695961
Epoch 9567
Loss = 3.2959e-02, PNorm = 531.9966, GNorm = 2.0615, lr_0 = 9.9324e-04
Validation auc = 0.700296
Epoch 9568
Loss = 4.2129e-02, PNorm = 532.0435, GNorm = 1.3491, lr_0 = 9.9324e-04
Validation auc = 0.704038
Epoch 9569
Loss = 1.2559e-02, PNorm = 532.0814, GNorm = 0.7083, lr_0 = 9.9324e-04
Loss = 2.4250e-02, PNorm = 532.1089, GNorm = 0.1941, lr_0 = 9.9324e-04
Validation auc = 0.700914
Epoch 9570
Loss = 1.6903e-02, PNorm = 532.1372, GNorm = 2.7085, lr_0 = 9.9323e-04
Validation auc = 0.698312
Epoch 9571
Loss = 2.0383e-02, PNorm = 532.1730, GNorm = 1.6669, lr_0 = 9.9323e-04
Validation auc = 0.705281
Epoch 9572
Loss = 3.5449e-02, PNorm = 532.2110, GNorm = 0.1956, lr_0 = 9.9323e-04
Validation auc = 0.702781
Epoch 9573
Loss = 1.8365e-01, PNorm = 532.2708, GNorm = 0.3502, lr_0 = 9.9323e-04
Validation auc = 0.689807
Epoch 9574
Loss = 4.3119e-02, PNorm = 532.3654, GNorm = 3.5562, lr_0 = 9.9323e-04
Validation auc = 0.707247
Epoch 9575
Loss = 4.7400e-02, PNorm = 532.4473, GNorm = 2.1595, lr_0 = 9.9323e-04
Validation auc = 0.700801
Epoch 9576
Loss = 2.8940e-02, PNorm = 532.5128, GNorm = 1.1576, lr_0 = 9.9323e-04
Validation auc = 0.698250
Epoch 9577
Loss = 1.4408e-02, PNorm = 532.5728, GNorm = 1.1138, lr_0 = 9.9323e-04
Validation auc = 0.700545
Epoch 9578
Loss = 6.7937e-02, PNorm = 532.6136, GNorm = 2.8400, lr_0 = 9.9323e-04
Validation auc = 0.699982
Epoch 9579
Loss = 9.0877e-03, PNorm = 532.6590, GNorm = 0.9668, lr_0 = 9.9323e-04
Loss = 1.4260e-02, PNorm = 532.7008, GNorm = 1.1510, lr_0 = 9.9323e-04
Validation auc = 0.690409
Epoch 9580
Loss = 8.2383e-02, PNorm = 532.7395, GNorm = 1.0292, lr_0 = 9.9323e-04
Validation auc = 0.681404
Epoch 9581
Loss = 2.3996e-02, PNorm = 532.7783, GNorm = 4.2332, lr_0 = 9.9323e-04
Validation auc = 0.678096
Epoch 9582
Loss = 6.6024e-02, PNorm = 532.8180, GNorm = 0.0500, lr_0 = 9.9323e-04
Validation auc = 0.685488
Epoch 9583
Loss = 6.8270e-02, PNorm = 532.8550, GNorm = 0.8953, lr_0 = 9.9323e-04
Validation auc = 0.687345
Epoch 9584
Loss = 3.7703e-02, PNorm = 532.8883, GNorm = 1.1668, lr_0 = 9.9322e-04
Validation auc = 0.686670
Epoch 9585
Loss = 4.5592e-03, PNorm = 532.9360, GNorm = 0.1131, lr_0 = 9.9322e-04
Validation auc = 0.685908
Epoch 9586
Loss = 2.5684e-02, PNorm = 532.9778, GNorm = 2.4655, lr_0 = 9.9322e-04
Validation auc = 0.685561
Epoch 9587
Loss = 2.9553e-02, PNorm = 533.0049, GNorm = 0.5106, lr_0 = 9.9322e-04
Validation auc = 0.692642
Epoch 9588
Loss = 3.5958e-03, PNorm = 533.0331, GNorm = 0.2224, lr_0 = 9.9322e-04
Validation auc = 0.692472
Epoch 9589
Loss = 2.8012e-03, PNorm = 533.0697, GNorm = 0.1195, lr_0 = 9.9322e-04
Loss = 4.7192e-02, PNorm = 533.1137, GNorm = 1.1773, lr_0 = 9.9322e-04
Validation auc = 0.695844
Epoch 9590
Loss = 4.0592e-02, PNorm = 533.1493, GNorm = 0.4685, lr_0 = 9.9322e-04
Validation auc = 0.693372
Epoch 9591
Loss = 5.3313e-02, PNorm = 533.1837, GNorm = 1.9384, lr_0 = 9.9322e-04
Validation auc = 0.689639
Epoch 9592
Loss = 4.0889e-02, PNorm = 533.2279, GNorm = 3.7139, lr_0 = 9.9322e-04
Validation auc = 0.703233
Epoch 9593
Loss = 3.1001e-02, PNorm = 533.2742, GNorm = 0.2543, lr_0 = 9.9322e-04
Validation auc = 0.709581
Epoch 9594
Loss = 9.1978e-02, PNorm = 533.3119, GNorm = 6.9839, lr_0 = 9.9322e-04
Validation auc = 0.710207
Epoch 9595
Loss = 2.9895e-02, PNorm = 533.3426, GNorm = 1.7157, lr_0 = 9.9322e-04
Validation auc = 0.706236
Epoch 9596
Loss = 3.6440e-02, PNorm = 533.3827, GNorm = 1.5645, lr_0 = 9.9322e-04
Validation auc = 0.702701
Epoch 9597
Loss = 1.0439e-01, PNorm = 533.4223, GNorm = 5.8773, lr_0 = 9.9322e-04
Validation auc = 0.706977
Epoch 9598
Loss = 4.2613e-02, PNorm = 533.4647, GNorm = 0.8672, lr_0 = 9.9321e-04
Validation auc = 0.706030
Epoch 9599
Loss = 3.5028e-03, PNorm = 533.4961, GNorm = 0.3004, lr_0 = 9.9321e-04
Loss = 2.4537e-02, PNorm = 533.5196, GNorm = 0.3376, lr_0 = 9.9321e-04
Validation auc = 0.699865
Epoch 9600
Loss = 2.0343e-02, PNorm = 533.5405, GNorm = 0.3855, lr_0 = 9.9321e-04
Validation auc = 0.697771
Epoch 9601
Loss = 1.4586e-02, PNorm = 533.5592, GNorm = 1.0993, lr_0 = 9.9321e-04
Validation auc = 0.697822
Epoch 9602
Loss = 1.4128e-02, PNorm = 533.5773, GNorm = 0.2366, lr_0 = 9.9321e-04
Validation auc = 0.690702
Epoch 9603
Loss = 6.6105e-02, PNorm = 533.6001, GNorm = 0.2145, lr_0 = 9.9321e-04
Validation auc = 0.697439
Epoch 9604
Loss = 2.3428e-02, PNorm = 533.6234, GNorm = 1.3569, lr_0 = 9.9321e-04
Validation auc = 0.706376
Epoch 9605
Loss = 4.1234e-02, PNorm = 533.6475, GNorm = 0.7072, lr_0 = 9.9321e-04
Validation auc = 0.706209
Epoch 9606
Loss = 9.7974e-03, PNorm = 533.6797, GNorm = 0.1650, lr_0 = 9.9321e-04
Validation auc = 0.707745
Epoch 9607
Loss = 2.5801e-03, PNorm = 533.7063, GNorm = 0.1132, lr_0 = 9.9321e-04
Validation auc = 0.711293
Epoch 9608
Loss = 4.1126e-03, PNorm = 533.7314, GNorm = 0.2761, lr_0 = 9.9321e-04
Validation auc = 0.712823
Epoch 9609
Loss = 2.8366e-03, PNorm = 533.7558, GNorm = 0.1266, lr_0 = 9.9321e-04
Loss = 1.1336e-02, PNorm = 533.7771, GNorm = 0.1826, lr_0 = 9.9321e-04
Validation auc = 0.710349
Epoch 9610
Loss = 3.3590e-02, PNorm = 533.7963, GNorm = 2.1554, lr_0 = 9.9320e-04
Validation auc = 0.711620
Epoch 9611
Loss = 1.6470e-02, PNorm = 533.8253, GNorm = 3.0812, lr_0 = 9.9320e-04
Validation auc = 0.709485
Epoch 9612
Loss = 2.5646e-02, PNorm = 533.8541, GNorm = 1.1285, lr_0 = 9.9320e-04
Validation auc = 0.703262
Epoch 9613
Loss = 1.8206e-02, PNorm = 533.8919, GNorm = 0.1571, lr_0 = 9.9320e-04
Validation auc = 0.711761
Epoch 9614
Loss = 4.0551e-02, PNorm = 533.9228, GNorm = 0.1646, lr_0 = 9.9320e-04
Validation auc = 0.711214
Epoch 9615
Loss = 3.8092e-02, PNorm = 533.9474, GNorm = 0.1059, lr_0 = 9.9320e-04
Validation auc = 0.705424
Epoch 9616
Loss = 9.5225e-03, PNorm = 533.9739, GNorm = 0.0828, lr_0 = 9.9320e-04
Validation auc = 0.703021
Epoch 9617
Loss = 5.4681e-03, PNorm = 533.9937, GNorm = 0.1723, lr_0 = 9.9320e-04
Validation auc = 0.698068
Epoch 9618
Loss = 1.8987e-02, PNorm = 534.0130, GNorm = 0.7207, lr_0 = 9.9320e-04
Validation auc = 0.695664
Epoch 9619
Loss = 5.3873e-02, PNorm = 534.0392, GNorm = 1.4033, lr_0 = 9.9320e-04
Loss = 1.7628e-02, PNorm = 534.0659, GNorm = 0.4632, lr_0 = 9.9320e-04
Validation auc = 0.694361
Epoch 9620
Loss = 1.0189e-02, PNorm = 534.0881, GNorm = 0.5324, lr_0 = 9.9320e-04
Validation auc = 0.689664
Epoch 9621
Loss = 1.5020e-02, PNorm = 534.1056, GNorm = 0.0797, lr_0 = 9.9320e-04
Validation auc = 0.690202
Epoch 9622
Loss = 2.9201e-02, PNorm = 534.1200, GNorm = 0.6571, lr_0 = 9.9320e-04
Validation auc = 0.691222
Epoch 9623
Loss = 3.5708e-02, PNorm = 534.1405, GNorm = 0.6973, lr_0 = 9.9320e-04
Validation auc = 0.697430
Epoch 9624
Loss = 1.2877e-02, PNorm = 534.1663, GNorm = 0.2093, lr_0 = 9.9319e-04
Validation auc = 0.703579
Epoch 9625
Loss = 2.5951e-02, PNorm = 534.1900, GNorm = 0.1227, lr_0 = 9.9319e-04
Validation auc = 0.703556
Epoch 9626
Loss = 1.3939e-02, PNorm = 534.2049, GNorm = 1.1340, lr_0 = 9.9319e-04
Validation auc = 0.699333
Epoch 9627
Loss = 1.0761e-02, PNorm = 534.2187, GNorm = 0.0531, lr_0 = 9.9319e-04
Validation auc = 0.700292
Epoch 9628
Loss = 7.5537e-02, PNorm = 534.2353, GNorm = 6.1568, lr_0 = 9.9319e-04
Validation auc = 0.701230
Epoch 9629
Loss = 1.2386e-02, PNorm = 534.2662, GNorm = 0.3607, lr_0 = 9.9319e-04
Loss = 3.9232e-02, PNorm = 534.2967, GNorm = 1.8121, lr_0 = 9.9319e-04
Validation auc = 0.701763
Epoch 9630
Loss = 1.9374e-02, PNorm = 534.3267, GNorm = 0.2084, lr_0 = 9.9319e-04
Validation auc = 0.698114
Epoch 9631
Loss = 5.2633e-02, PNorm = 534.3514, GNorm = 0.4499, lr_0 = 9.9319e-04
Validation auc = 0.698562
Epoch 9632
Loss = 1.6499e-02, PNorm = 534.3772, GNorm = 0.3192, lr_0 = 9.9319e-04
Validation auc = 0.700490
Epoch 9633
Loss = 1.7738e-02, PNorm = 534.3968, GNorm = 0.1376, lr_0 = 9.9319e-04
Validation auc = 0.695847
Epoch 9634
Loss = 1.6946e-02, PNorm = 534.4119, GNorm = 2.2128, lr_0 = 9.9319e-04
Validation auc = 0.694313
Epoch 9635
Loss = 7.1741e-03, PNorm = 534.4278, GNorm = 1.9705, lr_0 = 9.9319e-04
Validation auc = 0.694672
Epoch 9636
Loss = 1.0767e-02, PNorm = 534.4476, GNorm = 0.1083, lr_0 = 9.9319e-04
Validation auc = 0.697294
Epoch 9637
Loss = 1.8656e-01, PNorm = 534.4738, GNorm = 0.0259, lr_0 = 9.9319e-04
Validation auc = 0.705237
Epoch 9638
Loss = 1.1177e-01, PNorm = 534.5064, GNorm = 3.4071, lr_0 = 9.9318e-04
Validation auc = 0.699145
Epoch 9639
Loss = 4.7929e-03, PNorm = 534.5373, GNorm = 0.2736, lr_0 = 9.9318e-04
Loss = 2.3227e-02, PNorm = 534.5635, GNorm = 0.3103, lr_0 = 9.9318e-04
Validation auc = 0.692083
Epoch 9640
Loss = 1.8683e-02, PNorm = 534.5867, GNorm = 0.1821, lr_0 = 9.9318e-04
Validation auc = 0.687958
Epoch 9641
Loss = 1.6536e-02, PNorm = 534.6070, GNorm = 0.8759, lr_0 = 9.9318e-04
Validation auc = 0.680273
Epoch 9642
Loss = 3.3824e-02, PNorm = 534.6220, GNorm = 0.5262, lr_0 = 9.9318e-04
Validation auc = 0.674667
Epoch 9643
Loss = 1.9631e-02, PNorm = 534.6400, GNorm = 0.2372, lr_0 = 9.9318e-04
Validation auc = 0.671839
Epoch 9644
Loss = 2.7011e-02, PNorm = 534.6584, GNorm = 0.3271, lr_0 = 9.9318e-04
Validation auc = 0.672163
Epoch 9645
Loss = 7.3339e-02, PNorm = 534.6809, GNorm = 2.8028, lr_0 = 9.9318e-04
Validation auc = 0.672462
Epoch 9646
Loss = 4.7296e-02, PNorm = 534.7161, GNorm = 3.4951, lr_0 = 9.9318e-04
Validation auc = 0.675890
Epoch 9647
Loss = 1.3273e-02, PNorm = 534.7535, GNorm = 0.1661, lr_0 = 9.9318e-04
Validation auc = 0.676889
Epoch 9648
Loss = 7.3762e-03, PNorm = 534.7797, GNorm = 0.1823, lr_0 = 9.9318e-04
Validation auc = 0.675594
Epoch 9649
Loss = 8.8956e-03, PNorm = 534.7955, GNorm = 0.7420, lr_0 = 9.9318e-04
Loss = 3.3792e-03, PNorm = 534.8118, GNorm = 0.0450, lr_0 = 9.9318e-04
Validation auc = 0.671971
Epoch 9650
Loss = 3.3423e-02, PNorm = 534.8252, GNorm = 1.5380, lr_0 = 9.9317e-04
Validation auc = 0.669453
Epoch 9651
Loss = 1.2018e-02, PNorm = 534.8413, GNorm = 1.0564, lr_0 = 9.9317e-04
Validation auc = 0.669145
Epoch 9652
Loss = 5.4934e-02, PNorm = 534.8571, GNorm = 0.1257, lr_0 = 9.9317e-04
Validation auc = 0.670771
Epoch 9653
Loss = 2.4796e-02, PNorm = 534.8826, GNorm = 0.0328, lr_0 = 9.9317e-04
Validation auc = 0.677685
Epoch 9654
Loss = 1.6262e-02, PNorm = 534.9025, GNorm = 1.6188, lr_0 = 9.9317e-04
Validation auc = 0.680005
Epoch 9655
Loss = 2.3924e-02, PNorm = 534.9180, GNorm = 0.5258, lr_0 = 9.9317e-04
Validation auc = 0.681964
Epoch 9656
Loss = 3.1565e-02, PNorm = 534.9361, GNorm = 0.2575, lr_0 = 9.9317e-04
Validation auc = 0.681858
Epoch 9657
Loss = 1.4379e-02, PNorm = 534.9537, GNorm = 0.5979, lr_0 = 9.9317e-04
Validation auc = 0.684176
Epoch 9658
Loss = 2.5163e-02, PNorm = 534.9684, GNorm = 2.5473, lr_0 = 9.9317e-04
Validation auc = 0.686434
Epoch 9659
Loss = 3.6703e-03, PNorm = 534.9841, GNorm = 0.1092, lr_0 = 9.9317e-04
Loss = 2.8696e-02, PNorm = 534.9962, GNorm = 0.0613, lr_0 = 9.9317e-04
Validation auc = 0.688303
Epoch 9660
Loss = 4.1315e-03, PNorm = 535.0115, GNorm = 0.0551, lr_0 = 9.9317e-04
Validation auc = 0.688479
Epoch 9661
Loss = 2.3107e-02, PNorm = 535.0333, GNorm = 2.2276, lr_0 = 9.9317e-04
Validation auc = 0.689053
Epoch 9662
Loss = 4.0667e-03, PNorm = 535.0550, GNorm = 0.0754, lr_0 = 9.9317e-04
Validation auc = 0.689022
Epoch 9663
Loss = 1.5918e-02, PNorm = 535.0849, GNorm = 0.0202, lr_0 = 9.9317e-04
Validation auc = 0.682556
Epoch 9664
Loss = 1.2737e-02, PNorm = 535.1110, GNorm = 0.2805, lr_0 = 9.9316e-04
Validation auc = 0.675256
Epoch 9665
Loss = 3.2779e-02, PNorm = 535.1345, GNorm = 0.8114, lr_0 = 9.9316e-04
Validation auc = 0.678425
Epoch 9666
Loss = 2.4503e-02, PNorm = 535.1572, GNorm = 0.6149, lr_0 = 9.9316e-04
Validation auc = 0.673976
Epoch 9667
Loss = 1.3742e-03, PNorm = 535.1790, GNorm = 0.0255, lr_0 = 9.9316e-04
Validation auc = 0.671650
Epoch 9668
Loss = 6.5662e-03, PNorm = 535.1959, GNorm = 0.2277, lr_0 = 9.9316e-04
Validation auc = 0.668658
Epoch 9669
Loss = 2.8055e-02, PNorm = 535.2279, GNorm = 1.1702, lr_0 = 9.9316e-04
Loss = 1.1213e-02, PNorm = 535.2582, GNorm = 0.2479, lr_0 = 9.9316e-04
Validation auc = 0.662250
Epoch 9670
Loss = 2.2203e-02, PNorm = 535.2782, GNorm = 0.0656, lr_0 = 9.9316e-04
Validation auc = 0.661105
Epoch 9671
Loss = 1.3514e-02, PNorm = 535.2951, GNorm = 1.7306, lr_0 = 9.9316e-04
Validation auc = 0.661859
Epoch 9672
Loss = 8.8558e-03, PNorm = 535.3142, GNorm = 0.0564, lr_0 = 9.9316e-04
Validation auc = 0.658705
Epoch 9673
Loss = 2.0796e-02, PNorm = 535.3378, GNorm = 0.0211, lr_0 = 9.9316e-04
Validation auc = 0.657768
Epoch 9674
Loss = 1.1142e-02, PNorm = 535.3647, GNorm = 0.0848, lr_0 = 9.9316e-04
Validation auc = 0.667424
Epoch 9675
Loss = 3.4221e-02, PNorm = 535.3875, GNorm = 1.7839, lr_0 = 9.9316e-04
Validation auc = 0.672606
Epoch 9676
Loss = 1.7005e-02, PNorm = 535.4123, GNorm = 0.8675, lr_0 = 9.9316e-04
Validation auc = 0.675185
Epoch 9677
Loss = 3.3851e-02, PNorm = 535.4333, GNorm = 0.4047, lr_0 = 9.9315e-04
Validation auc = 0.670906
Epoch 9678
Loss = 5.3362e-02, PNorm = 535.4543, GNorm = 5.1087, lr_0 = 9.9315e-04
Validation auc = 0.670552
Epoch 9679
Loss = 2.3680e-03, PNorm = 535.4791, GNorm = 0.1061, lr_0 = 9.9315e-04
Loss = 2.6249e-02, PNorm = 535.5001, GNorm = 1.2422, lr_0 = 9.9315e-04
Validation auc = 0.673783
Epoch 9680
Loss = 1.3105e-02, PNorm = 535.5215, GNorm = 0.0779, lr_0 = 9.9315e-04
Validation auc = 0.680744
Epoch 9681
Loss = 1.3189e-02, PNorm = 535.5365, GNorm = 0.1636, lr_0 = 9.9315e-04
Validation auc = 0.680349
Epoch 9682
Loss = 1.2936e-02, PNorm = 535.5472, GNorm = 0.0930, lr_0 = 9.9315e-04
Validation auc = 0.677621
Epoch 9683
Loss = 4.8937e-02, PNorm = 535.5617, GNorm = 2.9377, lr_0 = 9.9315e-04
Validation auc = 0.689422
Epoch 9684
Loss = 8.9224e-02, PNorm = 535.5962, GNorm = 2.9795, lr_0 = 9.9315e-04
Validation auc = 0.695173
Epoch 9685
Loss = 2.5857e-02, PNorm = 535.6373, GNorm = 0.7948, lr_0 = 9.9315e-04
Validation auc = 0.696430
Epoch 9686
Loss = 3.1165e-02, PNorm = 535.6660, GNorm = 0.2360, lr_0 = 9.9315e-04
Validation auc = 0.698369
Epoch 9687
Loss = 7.1081e-02, PNorm = 535.6856, GNorm = 0.1663, lr_0 = 9.9315e-04
Validation auc = 0.697286
Epoch 9688
Loss = 4.1608e-02, PNorm = 535.7145, GNorm = 1.4879, lr_0 = 9.9315e-04
Validation auc = 0.700821
Epoch 9689
Loss = 1.2027e-01, PNorm = 535.7410, GNorm = 2.3265, lr_0 = 9.9315e-04
Loss = 1.4494e-02, PNorm = 535.7765, GNorm = 0.0692, lr_0 = 9.9315e-04
Validation auc = 0.705739
Epoch 9690
Loss = 6.5212e-03, PNorm = 535.8036, GNorm = 1.7790, lr_0 = 9.9314e-04
Validation auc = 0.708703
Epoch 9691
Loss = 6.6399e-02, PNorm = 535.8307, GNorm = 0.0984, lr_0 = 9.9314e-04
Validation auc = 0.718713
Epoch 9692
Loss = 3.1783e-03, PNorm = 535.8618, GNorm = 0.1107, lr_0 = 9.9314e-04
Validation auc = 0.718355
Epoch 9693
Loss = 4.3227e-02, PNorm = 535.8904, GNorm = 5.5869, lr_0 = 9.9314e-04
Validation auc = 0.724811
Epoch 9694
Loss = 3.0315e-02, PNorm = 535.9320, GNorm = 0.1001, lr_0 = 9.9314e-04
Validation auc = 0.725824
Epoch 9695
Loss = 1.5160e-02, PNorm = 535.9811, GNorm = 0.7672, lr_0 = 9.9314e-04
Validation auc = 0.723048
Epoch 9696
Loss = 1.1445e-02, PNorm = 536.0314, GNorm = 0.1377, lr_0 = 9.9314e-04
Validation auc = 0.717428
Epoch 9697
Loss = 3.8776e-02, PNorm = 536.0701, GNorm = 3.5774, lr_0 = 9.9314e-04
Validation auc = 0.712486
Epoch 9698
Loss = 6.6803e-02, PNorm = 536.1033, GNorm = 0.6288, lr_0 = 9.9314e-04
Validation auc = 0.711187
Epoch 9699
Loss = 3.7959e-03, PNorm = 536.1312, GNorm = 0.1466, lr_0 = 9.9314e-04
Loss = 1.8914e-02, PNorm = 536.1500, GNorm = 0.3265, lr_0 = 9.9314e-04
Validation auc = 0.711351
Epoch 9700
Loss = 1.4961e-02, PNorm = 536.1630, GNorm = 2.7712, lr_0 = 9.9314e-04
Validation auc = 0.711179
Epoch 9701
Loss = 8.0467e-03, PNorm = 536.1765, GNorm = 0.0749, lr_0 = 9.9314e-04
Validation auc = 0.710658
Epoch 9702
Loss = 5.7077e-02, PNorm = 536.1952, GNorm = 1.6455, lr_0 = 9.9314e-04
Validation auc = 0.711141
Epoch 9703
Loss = 4.1483e-02, PNorm = 536.2236, GNorm = 0.5262, lr_0 = 9.9314e-04
Validation auc = 0.708064
Epoch 9704
Loss = 5.2176e-02, PNorm = 536.2566, GNorm = 0.0406, lr_0 = 9.9313e-04
Validation auc = 0.700322
Epoch 9705
Loss = 8.6383e-03, PNorm = 536.2902, GNorm = 0.6504, lr_0 = 9.9313e-04
Validation auc = 0.703512
Epoch 9706
Loss = 1.3713e-02, PNorm = 536.3183, GNorm = 0.1327, lr_0 = 9.9313e-04
Validation auc = 0.701350
Epoch 9707
Loss = 6.1513e-02, PNorm = 536.3400, GNorm = 2.0308, lr_0 = 9.9313e-04
Validation auc = 0.698790
Epoch 9708
Loss = 2.4566e-02, PNorm = 536.3635, GNorm = 1.8240, lr_0 = 9.9313e-04
Validation auc = 0.703869
Epoch 9709
Loss = 2.7932e-02, PNorm = 536.3927, GNorm = 1.2441, lr_0 = 9.9313e-04
Loss = 1.8680e-02, PNorm = 536.4226, GNorm = 0.2383, lr_0 = 9.9313e-04
Validation auc = 0.704368
Epoch 9710
Loss = 2.7569e-02, PNorm = 536.4502, GNorm = 0.4286, lr_0 = 9.9313e-04
Validation auc = 0.702911
Epoch 9711
Loss = 2.4308e-02, PNorm = 536.4770, GNorm = 0.0896, lr_0 = 9.9313e-04
Validation auc = 0.705559
Epoch 9712
Loss = 2.6655e-02, PNorm = 536.5012, GNorm = 0.4129, lr_0 = 9.9313e-04
Validation auc = 0.707313
Epoch 9713
Loss = 4.0796e-02, PNorm = 536.5349, GNorm = 0.2161, lr_0 = 9.9313e-04
Validation auc = 0.709628
Epoch 9714
Loss = 1.8521e-02, PNorm = 536.5777, GNorm = 1.6576, lr_0 = 9.9313e-04
Validation auc = 0.710772
Epoch 9715
Loss = 2.0987e-02, PNorm = 536.6043, GNorm = 0.1735, lr_0 = 9.9313e-04
Validation auc = 0.704084
Epoch 9716
Loss = 2.3945e-02, PNorm = 536.6230, GNorm = 1.2543, lr_0 = 9.9313e-04
Validation auc = 0.696900
Epoch 9717
Loss = 5.1592e-03, PNorm = 536.6378, GNorm = 0.2255, lr_0 = 9.9312e-04
Validation auc = 0.699115
Epoch 9718
Loss = 5.7717e-03, PNorm = 536.6492, GNorm = 1.2616, lr_0 = 9.9312e-04
Validation auc = 0.696506
Epoch 9719
Loss = 1.4820e-03, PNorm = 536.6614, GNorm = 0.0704, lr_0 = 9.9312e-04
Loss = 2.2465e-02, PNorm = 536.6752, GNorm = 2.0546, lr_0 = 9.9312e-04
Validation auc = 0.692166
Epoch 9720
Loss = 6.2678e-03, PNorm = 536.6910, GNorm = 0.0906, lr_0 = 9.9312e-04
Validation auc = 0.688895
Epoch 9721
Loss = 2.5170e-02, PNorm = 536.7071, GNorm = 0.0195, lr_0 = 9.9312e-04
Validation auc = 0.684571
Epoch 9722
Loss = 9.7151e-03, PNorm = 536.7204, GNorm = 1.2260, lr_0 = 9.9312e-04
Validation auc = 0.681699
Epoch 9723
Loss = 1.0217e-02, PNorm = 536.7366, GNorm = 0.1296, lr_0 = 9.9312e-04
Validation auc = 0.684523
Epoch 9724
Loss = 3.2615e-02, PNorm = 536.7524, GNorm = 0.0394, lr_0 = 9.9312e-04
Validation auc = 0.682644
Epoch 9725
Loss = 5.8253e-02, PNorm = 536.7724, GNorm = 9.9023, lr_0 = 9.9312e-04
Validation auc = 0.686796
Epoch 9726
Loss = 6.3989e-03, PNorm = 536.8020, GNorm = 0.2353, lr_0 = 9.9312e-04
Validation auc = 0.681817
Epoch 9727
Loss = 2.0488e-02, PNorm = 536.8476, GNorm = 1.0922, lr_0 = 9.9312e-04
Validation auc = 0.682987
Epoch 9728
Loss = 1.7404e-02, PNorm = 536.8829, GNorm = 0.0761, lr_0 = 9.9312e-04
Validation auc = 0.675369
Epoch 9729
Loss = 2.8075e-03, PNorm = 536.9120, GNorm = 0.1543, lr_0 = 9.9312e-04
Loss = 2.1163e-02, PNorm = 536.9412, GNorm = 0.5644, lr_0 = 9.9312e-04
Validation auc = 0.683126
Epoch 9730
Loss = 1.5793e-02, PNorm = 536.9678, GNorm = 0.0595, lr_0 = 9.9311e-04
Validation auc = 0.694331
Epoch 9731
Loss = 5.6749e-02, PNorm = 536.9876, GNorm = 3.0406, lr_0 = 9.9311e-04
Validation auc = 0.695791
Epoch 9732
Loss = 7.9671e-03, PNorm = 537.0036, GNorm = 2.7965, lr_0 = 9.9311e-04
Validation auc = 0.698781
Epoch 9733
Loss = 4.1843e-02, PNorm = 537.0187, GNorm = 0.0882, lr_0 = 9.9311e-04
Validation auc = 0.690428
Epoch 9734
Loss = 2.0838e-02, PNorm = 537.0365, GNorm = 0.0548, lr_0 = 9.9311e-04
Validation auc = 0.679943
Epoch 9735
Loss = 3.5232e-03, PNorm = 537.0542, GNorm = 0.0888, lr_0 = 9.9311e-04
Validation auc = 0.682514
Epoch 9736
Loss = 9.2382e-03, PNorm = 537.0749, GNorm = 1.7664, lr_0 = 9.9311e-04
Validation auc = 0.685681
Epoch 9737
Loss = 1.9254e-01, PNorm = 537.1088, GNorm = 3.1846, lr_0 = 9.9311e-04
Validation auc = 0.683883
Epoch 9738
Loss = 1.7961e-02, PNorm = 537.1579, GNorm = 0.5651, lr_0 = 9.9311e-04
Validation auc = 0.682458
Epoch 9739
Loss = 7.6087e-03, PNorm = 537.1972, GNorm = 0.3559, lr_0 = 9.9311e-04
Loss = 3.3106e-02, PNorm = 537.2342, GNorm = 0.5950, lr_0 = 9.9311e-04
Validation auc = 0.692141
Epoch 9740
Loss = 7.7041e-02, PNorm = 537.2724, GNorm = 1.3740, lr_0 = 9.9311e-04
Validation auc = 0.692261
Epoch 9741
Loss = 2.7303e-02, PNorm = 537.3226, GNorm = 0.3007, lr_0 = 9.9311e-04
Validation auc = 0.691742
Epoch 9742
Loss = 2.3816e-02, PNorm = 537.3681, GNorm = 1.3976, lr_0 = 9.9311e-04
Validation auc = 0.694163
Epoch 9743
Loss = 1.3815e-02, PNorm = 537.3978, GNorm = 0.0334, lr_0 = 9.9311e-04
Validation auc = 0.696799
Epoch 9744
Loss = 5.2488e-02, PNorm = 537.4197, GNorm = 1.7279, lr_0 = 9.9310e-04
Validation auc = 0.693607
Epoch 9745
Loss = 6.4337e-02, PNorm = 537.4458, GNorm = 4.6965, lr_0 = 9.9310e-04
Validation auc = 0.704407
Epoch 9746
Loss = 1.1592e-02, PNorm = 537.4793, GNorm = 2.0314, lr_0 = 9.9310e-04
Validation auc = 0.708628
Epoch 9747
Loss = 7.8681e-02, PNorm = 537.5089, GNorm = 0.0896, lr_0 = 9.9310e-04
Validation auc = 0.711111
Epoch 9748
Loss = 7.9364e-03, PNorm = 537.5383, GNorm = 0.4966, lr_0 = 9.9310e-04
Validation auc = 0.714603
Epoch 9749
Loss = 1.3182e-01, PNorm = 537.5706, GNorm = 3.2598, lr_0 = 9.9310e-04
Loss = 5.5672e-02, PNorm = 537.6070, GNorm = 0.5247, lr_0 = 9.9310e-04
Validation auc = 0.717442
Epoch 9750
Loss = 1.6377e-02, PNorm = 537.6362, GNorm = 0.2445, lr_0 = 9.9310e-04
Validation auc = 0.713715
Epoch 9751
Loss = 2.7320e-02, PNorm = 537.6627, GNorm = 0.1934, lr_0 = 9.9310e-04
Validation auc = 0.707181
Epoch 9752
Loss = 2.9697e-02, PNorm = 537.6867, GNorm = 0.1956, lr_0 = 9.9310e-04
Validation auc = 0.697647
Epoch 9753
Loss = 8.8986e-03, PNorm = 537.7066, GNorm = 0.1845, lr_0 = 9.9310e-04
Validation auc = 0.695977
Epoch 9754
Loss = 1.5589e-02, PNorm = 537.7282, GNorm = 0.5189, lr_0 = 9.9310e-04
Validation auc = 0.692275
Epoch 9755
Loss = 2.0289e-02, PNorm = 537.7520, GNorm = 1.7920, lr_0 = 9.9310e-04
Validation auc = 0.698098
Epoch 9756
Loss = 4.7449e-02, PNorm = 537.7768, GNorm = 2.4728, lr_0 = 9.9310e-04
Validation auc = 0.703774
Epoch 9757
Loss = 4.1092e-02, PNorm = 537.8010, GNorm = 1.4799, lr_0 = 9.9309e-04
Validation auc = 0.701959
Epoch 9758
Loss = 2.1621e-03, PNorm = 537.8247, GNorm = 0.0592, lr_0 = 9.9309e-04
Validation auc = 0.696499
Epoch 9759
Loss = 6.5943e-02, PNorm = 537.8437, GNorm = 2.6496, lr_0 = 9.9309e-04
Loss = 1.1975e-02, PNorm = 537.8657, GNorm = 0.7716, lr_0 = 9.9309e-04
Validation auc = 0.700169
Epoch 9760
Loss = 2.1366e-02, PNorm = 537.8888, GNorm = 2.9089, lr_0 = 9.9309e-04
Validation auc = 0.711221
Epoch 9761
Loss = 4.3745e-02, PNorm = 537.9131, GNorm = 2.2598, lr_0 = 9.9309e-04
Validation auc = 0.716085
Epoch 9762
Loss = 1.0478e-02, PNorm = 537.9396, GNorm = 0.0704, lr_0 = 9.9309e-04
Validation auc = 0.716639
Epoch 9763
Loss = 9.5369e-03, PNorm = 537.9613, GNorm = 0.1026, lr_0 = 9.9309e-04
Validation auc = 0.717174
Epoch 9764
Loss = 4.4456e-02, PNorm = 537.9850, GNorm = 0.7592, lr_0 = 9.9309e-04
Validation auc = 0.713168
Epoch 9765
Loss = 7.1012e-03, PNorm = 538.0142, GNorm = 0.8290, lr_0 = 9.9309e-04
Validation auc = 0.709732
Epoch 9766
Loss = 1.2476e-02, PNorm = 538.0410, GNorm = 0.1316, lr_0 = 9.9309e-04
Validation auc = 0.710259
Epoch 9767
Loss = 6.5797e-02, PNorm = 538.0622, GNorm = 8.5610, lr_0 = 9.9309e-04
Validation auc = 0.706604
Epoch 9768
Loss = 4.0500e-03, PNorm = 538.0853, GNorm = 1.2952, lr_0 = 9.9309e-04
Validation auc = 0.705609
Epoch 9769
Loss = 6.8269e-04, PNorm = 538.1196, GNorm = 0.0449, lr_0 = 9.9309e-04
Loss = 1.1747e-02, PNorm = 538.1558, GNorm = 0.7732, lr_0 = 9.9309e-04
Validation auc = 0.697625
Epoch 9770
Loss = 2.2961e-02, PNorm = 538.1812, GNorm = 0.1844, lr_0 = 9.9308e-04
Validation auc = 0.696613
Epoch 9771
Loss = 4.4496e-02, PNorm = 538.2089, GNorm = 3.3750, lr_0 = 9.9308e-04
Validation auc = 0.698639
Epoch 9772
Loss = 2.8162e-02, PNorm = 538.2441, GNorm = 1.3215, lr_0 = 9.9308e-04
Validation auc = 0.692556
Epoch 9773
Loss = 2.1251e-02, PNorm = 538.2724, GNorm = 0.0828, lr_0 = 9.9308e-04
Validation auc = 0.690953
Epoch 9774
Loss = 9.7417e-03, PNorm = 538.2896, GNorm = 0.7817, lr_0 = 9.9308e-04
Validation auc = 0.695373
Epoch 9775
Loss = 1.9016e-02, PNorm = 538.3050, GNorm = 0.8101, lr_0 = 9.9308e-04
Validation auc = 0.695285
Epoch 9776
Loss = 2.9930e-02, PNorm = 538.3231, GNorm = 2.9564, lr_0 = 9.9308e-04
Validation auc = 0.698186
Epoch 9777
Loss = 1.4559e-02, PNorm = 538.3401, GNorm = 0.0927, lr_0 = 9.9308e-04
Validation auc = 0.693667
Epoch 9778
Loss = 3.6560e-03, PNorm = 538.3542, GNorm = 0.1395, lr_0 = 9.9308e-04
Validation auc = 0.691316
Epoch 9779
Loss = 3.9985e-02, PNorm = 538.3864, GNorm = 1.5813, lr_0 = 9.9308e-04
Loss = 3.1013e-02, PNorm = 538.4243, GNorm = 0.5032, lr_0 = 9.9308e-04
Validation auc = 0.697197
Epoch 9780
Loss = 3.0912e-02, PNorm = 538.4588, GNorm = 0.1847, lr_0 = 9.9308e-04
Validation auc = 0.695006
Epoch 9781
Loss = 2.4361e-02, PNorm = 538.4900, GNorm = 0.0146, lr_0 = 9.9308e-04
Validation auc = 0.699361
Epoch 9782
Loss = 1.5911e-02, PNorm = 538.5068, GNorm = 0.0106, lr_0 = 9.9308e-04
Validation auc = 0.704892
Epoch 9783
Loss = 1.8929e-02, PNorm = 538.5232, GNorm = 1.3862, lr_0 = 9.9307e-04
Validation auc = 0.695878
Epoch 9784
Loss = 1.0181e-02, PNorm = 538.5443, GNorm = 0.0592, lr_0 = 9.9307e-04
Validation auc = 0.687770
Epoch 9785
Loss = 5.8093e-02, PNorm = 538.5723, GNorm = 0.3505, lr_0 = 9.9307e-04
Validation auc = 0.700390
Epoch 9786
Loss = 2.5270e-03, PNorm = 538.6029, GNorm = 0.0327, lr_0 = 9.9307e-04
Validation auc = 0.696828
Epoch 9787
Loss = 3.1734e-03, PNorm = 538.6237, GNorm = 0.1542, lr_0 = 9.9307e-04
Validation auc = 0.697112
Epoch 9788
Loss = 6.0899e-02, PNorm = 538.6416, GNorm = 1.8929, lr_0 = 9.9307e-04
Validation auc = 0.693940
Epoch 9789
Loss = 6.7533e-03, PNorm = 538.6627, GNorm = 0.4520, lr_0 = 9.9307e-04
Loss = 1.7477e-02, PNorm = 538.6844, GNorm = 0.8990, lr_0 = 9.9307e-04
Validation auc = 0.694844
Epoch 9790
Loss = 3.3985e-02, PNorm = 538.7075, GNorm = 4.9390, lr_0 = 9.9307e-04
Validation auc = 0.696587
Epoch 9791
Loss = 4.7511e-02, PNorm = 538.7335, GNorm = 5.1622, lr_0 = 9.9307e-04
Validation auc = 0.689575
Epoch 9792
Loss = 3.8461e-02, PNorm = 538.7689, GNorm = 0.2306, lr_0 = 9.9307e-04
Validation auc = 0.693853
Epoch 9793
Loss = 5.1399e-02, PNorm = 538.8048, GNorm = 2.2653, lr_0 = 9.9307e-04
Validation auc = 0.697106
Epoch 9794
Loss = 1.3722e-02, PNorm = 538.8397, GNorm = 0.6769, lr_0 = 9.9307e-04
Validation auc = 0.697801
Epoch 9795
Loss = 1.3947e-02, PNorm = 538.8650, GNorm = 1.1963, lr_0 = 9.9307e-04
Validation auc = 0.696702
Epoch 9796
Loss = 2.3191e-02, PNorm = 538.8893, GNorm = 0.5884, lr_0 = 9.9307e-04
Validation auc = 0.705954
Epoch 9797
Loss = 1.6884e-02, PNorm = 538.9120, GNorm = 0.6383, lr_0 = 9.9306e-04
Validation auc = 0.716023
Epoch 9798
Loss = 3.4961e-02, PNorm = 538.9341, GNorm = 2.4940, lr_0 = 9.9306e-04
Validation auc = 0.709363
Epoch 9799
Loss = 1.3240e-03, PNorm = 538.9576, GNorm = 0.0571, lr_0 = 9.9306e-04
Loss = 2.3403e-02, PNorm = 538.9800, GNorm = 0.0304, lr_0 = 9.9306e-04
Validation auc = 0.713368
Epoch 9800
Loss = 2.9341e-02, PNorm = 539.0012, GNorm = 0.0946, lr_0 = 9.9306e-04
Validation auc = 0.714101
Epoch 9801
Loss = 5.1976e-03, PNorm = 539.0270, GNorm = 0.0786, lr_0 = 9.9306e-04
Validation auc = 0.711664
Epoch 9802
Loss = 4.5237e-02, PNorm = 539.0472, GNorm = 1.8976, lr_0 = 9.9306e-04
Validation auc = 0.711462
Epoch 9803
Loss = 6.6200e-02, PNorm = 539.0667, GNorm = 0.5657, lr_0 = 9.9306e-04
Validation auc = 0.710167
Epoch 9804
Loss = 2.2184e-02, PNorm = 539.0913, GNorm = 0.8281, lr_0 = 9.9306e-04
Validation auc = 0.708318
Epoch 9805
Loss = 2.0541e-02, PNorm = 539.1082, GNorm = 0.1382, lr_0 = 9.9306e-04
Validation auc = 0.710517
Epoch 9806
Loss = 3.8258e-02, PNorm = 539.1302, GNorm = 0.5191, lr_0 = 9.9306e-04
Validation auc = 0.709717
Epoch 9807
Loss = 1.5194e-02, PNorm = 539.1602, GNorm = 1.5247, lr_0 = 9.9306e-04
Validation auc = 0.711104
Epoch 9808
Loss = 2.3469e-02, PNorm = 539.1922, GNorm = 2.3495, lr_0 = 9.9306e-04
Validation auc = 0.711702
Epoch 9809
Loss = 6.0617e-04, PNorm = 539.2297, GNorm = 0.0358, lr_0 = 9.9306e-04
Loss = 1.8978e-02, PNorm = 539.2584, GNorm = 1.6796, lr_0 = 9.9306e-04
Validation auc = 0.714290
Epoch 9810
Loss = 2.9991e-02, PNorm = 539.2809, GNorm = 6.0542, lr_0 = 9.9305e-04
Validation auc = 0.711847
Epoch 9811
Loss = 2.7474e-02, PNorm = 539.3043, GNorm = 1.5165, lr_0 = 9.9305e-04
Validation auc = 0.705114
Epoch 9812
Loss = 5.6012e-02, PNorm = 539.3322, GNorm = 4.5383, lr_0 = 9.9305e-04
Validation auc = 0.704156
Epoch 9813
Loss = 1.9059e-02, PNorm = 539.3683, GNorm = 0.0653, lr_0 = 9.9305e-04
Validation auc = 0.700538
Epoch 9814
Loss = 2.2085e-02, PNorm = 539.3967, GNorm = 1.1092, lr_0 = 9.9305e-04
Validation auc = 0.704861
Epoch 9815
Loss = 6.8893e-03, PNorm = 539.4201, GNorm = 0.2781, lr_0 = 9.9305e-04
Validation auc = 0.704273
Epoch 9816
Loss = 4.0429e-03, PNorm = 539.4405, GNorm = 0.1210, lr_0 = 9.9305e-04
Validation auc = 0.697339
Epoch 9817
Loss = 3.7992e-02, PNorm = 539.4604, GNorm = 1.3647, lr_0 = 9.9305e-04
Validation auc = 0.695179
Epoch 9818
Loss = 2.0268e-03, PNorm = 539.4760, GNorm = 0.1017, lr_0 = 9.9305e-04
Validation auc = 0.696009
Epoch 9819
Loss = 2.1449e-02, PNorm = 539.4882, GNorm = 0.8713, lr_0 = 9.9305e-04
Loss = 3.0578e-02, PNorm = 539.5053, GNorm = 3.6759, lr_0 = 9.9305e-04
Validation auc = 0.698324
Epoch 9820
Loss = 1.5728e-02, PNorm = 539.5248, GNorm = 0.7172, lr_0 = 9.9305e-04
Validation auc = 0.697648
Epoch 9821
Loss = 8.4095e-03, PNorm = 539.5441, GNorm = 0.2358, lr_0 = 9.9305e-04
Validation auc = 0.698935
Epoch 9822
Loss = 1.0228e-02, PNorm = 539.5567, GNorm = 0.0699, lr_0 = 9.9305e-04
Validation auc = 0.697026
Epoch 9823
Loss = 4.3076e-03, PNorm = 539.5661, GNorm = 0.0476, lr_0 = 9.9304e-04
Validation auc = 0.697467
Epoch 9824
Loss = 1.2861e-02, PNorm = 539.5747, GNorm = 0.0374, lr_0 = 9.9304e-04
Validation auc = 0.698926
Epoch 9825
Loss = 1.4774e-03, PNorm = 539.5842, GNorm = 0.1257, lr_0 = 9.9304e-04
Validation auc = 0.699609
Epoch 9826
Loss = 2.9540e-03, PNorm = 539.5903, GNorm = 0.0181, lr_0 = 9.9304e-04
Validation auc = 0.701195
Epoch 9827
Loss = 3.2025e-02, PNorm = 539.5986, GNorm = 0.4433, lr_0 = 9.9304e-04
Validation auc = 0.704305
Epoch 9828
Loss = 9.6249e-02, PNorm = 539.6198, GNorm = 2.8167, lr_0 = 9.9304e-04
Validation auc = 0.705234
Epoch 9829
Loss = 6.0193e-03, PNorm = 539.6397, GNorm = 0.5505, lr_0 = 9.9304e-04
Loss = 3.7767e-02, PNorm = 539.6596, GNorm = 1.5095, lr_0 = 9.9304e-04
Validation auc = 0.708618
Epoch 9830
Loss = 2.2423e-02, PNorm = 539.6848, GNorm = 0.3884, lr_0 = 9.9304e-04
Validation auc = 0.711904
Epoch 9831
Loss = 2.3398e-02, PNorm = 539.7034, GNorm = 0.1085, lr_0 = 9.9304e-04
Validation auc = 0.711073
Epoch 9832
Loss = 2.2111e-02, PNorm = 539.7180, GNorm = 2.1371, lr_0 = 9.9304e-04
Validation auc = 0.712098
Epoch 9833
Loss = 7.1478e-03, PNorm = 539.7315, GNorm = 0.1171, lr_0 = 9.9304e-04
Validation auc = 0.715098
Epoch 9834
Loss = 4.7618e-02, PNorm = 539.7472, GNorm = 5.7612, lr_0 = 9.9304e-04
Validation auc = 0.716059
Epoch 9835
Loss = 2.4156e-02, PNorm = 539.7756, GNorm = 0.1145, lr_0 = 9.9304e-04
Validation auc = 0.722000
Epoch 9836
Loss = 4.1687e-02, PNorm = 539.8055, GNorm = 1.2744, lr_0 = 9.9304e-04
Validation auc = 0.728190
Epoch 9837
Loss = 7.0774e-02, PNorm = 539.8439, GNorm = 1.3263, lr_0 = 9.9303e-04
Validation auc = 0.728474
Epoch 9838
Loss = 2.4818e-02, PNorm = 539.8787, GNorm = 0.9255, lr_0 = 9.9303e-04
Validation auc = 0.723685
Epoch 9839
Loss = 1.0158e-03, PNorm = 539.9064, GNorm = 0.0600, lr_0 = 9.9303e-04
Loss = 2.4797e-02, PNorm = 539.9237, GNorm = 0.2743, lr_0 = 9.9303e-04
Validation auc = 0.719530
Epoch 9840
Loss = 2.9563e-02, PNorm = 539.9386, GNorm = 0.1903, lr_0 = 9.9303e-04
Validation auc = 0.717451
Epoch 9841
Loss = 1.8215e-02, PNorm = 539.9541, GNorm = 0.2684, lr_0 = 9.9303e-04
Validation auc = 0.715651
Epoch 9842
Loss = 6.6129e-02, PNorm = 539.9777, GNorm = 1.3121, lr_0 = 9.9303e-04
Validation auc = 0.718079
Epoch 9843
Loss = 2.0160e-02, PNorm = 540.0075, GNorm = 1.0424, lr_0 = 9.9303e-04
Validation auc = 0.718350
Epoch 9844
Loss = 1.7278e-02, PNorm = 540.0390, GNorm = 3.6638, lr_0 = 9.9303e-04
Validation auc = 0.723238
Epoch 9845
Loss = 2.4932e-02, PNorm = 540.0663, GNorm = 0.6592, lr_0 = 9.9303e-04
Validation auc = 0.724050
Epoch 9846
Loss = 6.5198e-03, PNorm = 540.0902, GNorm = 0.3298, lr_0 = 9.9303e-04
Validation auc = 0.723195
Epoch 9847
Loss = 4.9004e-03, PNorm = 540.1092, GNorm = 0.2206, lr_0 = 9.9303e-04
Validation auc = 0.724710
Epoch 9848
Loss = 5.3374e-02, PNorm = 540.1255, GNorm = 2.9585, lr_0 = 9.9303e-04
Validation auc = 0.715918
Epoch 9849
Loss = 4.4898e-03, PNorm = 540.1414, GNorm = 0.6080, lr_0 = 9.9303e-04
Loss = 5.2729e-02, PNorm = 540.1674, GNorm = 0.3467, lr_0 = 9.9303e-04
Validation auc = 0.721606
Epoch 9850
Loss = 3.7109e-02, PNorm = 540.1985, GNorm = 0.9470, lr_0 = 9.9302e-04
Validation auc = 0.716400
Epoch 9851
Loss = 9.8965e-03, PNorm = 540.2290, GNorm = 0.2885, lr_0 = 9.9302e-04
Validation auc = 0.706835
Epoch 9852
Loss = 2.0307e-02, PNorm = 540.2495, GNorm = 0.0632, lr_0 = 9.9302e-04
Validation auc = 0.703822
Epoch 9853
Loss = 1.4364e-02, PNorm = 540.2651, GNorm = 1.6519, lr_0 = 9.9302e-04
Validation auc = 0.707992
Epoch 9854
Loss = 3.1902e-02, PNorm = 540.2832, GNorm = 3.9728, lr_0 = 9.9302e-04
Validation auc = 0.713042
Epoch 9855
Loss = 1.3303e-02, PNorm = 540.3030, GNorm = 0.3348, lr_0 = 9.9302e-04
Validation auc = 0.713586
Epoch 9856
Loss = 7.1911e-02, PNorm = 540.3245, GNorm = 0.1096, lr_0 = 9.9302e-04
Validation auc = 0.718038
Epoch 9857
Loss = 9.2849e-03, PNorm = 540.3466, GNorm = 1.0902, lr_0 = 9.9302e-04
Validation auc = 0.718650
Epoch 9858
Loss = 4.7747e-03, PNorm = 540.3749, GNorm = 0.1868, lr_0 = 9.9302e-04
Validation auc = 0.716301
Epoch 9859
Loss = 2.0671e-02, PNorm = 540.4039, GNorm = 0.7948, lr_0 = 9.9302e-04
Loss = 4.0229e-02, PNorm = 540.4281, GNorm = 0.8084, lr_0 = 9.9302e-04
Validation auc = 0.717384
Epoch 9860
Loss = 2.4671e-02, PNorm = 540.4586, GNorm = 0.5498, lr_0 = 9.9302e-04
Validation auc = 0.713691
Epoch 9861
Loss = 3.6902e-02, PNorm = 540.4848, GNorm = 0.0951, lr_0 = 9.9302e-04
Validation auc = 0.714098
Epoch 9862
Loss = 2.5584e-02, PNorm = 540.5053, GNorm = 0.8912, lr_0 = 9.9302e-04
Validation auc = 0.713670
Epoch 9863
Loss = 3.8620e-02, PNorm = 540.5270, GNorm = 0.4149, lr_0 = 9.9301e-04
Validation auc = 0.711647
Epoch 9864
Loss = 1.6588e-02, PNorm = 540.5488, GNorm = 0.5171, lr_0 = 9.9301e-04
Validation auc = 0.717323
Epoch 9865
Loss = 3.2658e-02, PNorm = 540.5737, GNorm = 0.0462, lr_0 = 9.9301e-04
Validation auc = 0.720863
Epoch 9866
Loss = 2.9386e-02, PNorm = 540.5954, GNorm = 1.1074, lr_0 = 9.9301e-04
Validation auc = 0.716319
Epoch 9867
Loss = 3.8644e-03, PNorm = 540.6211, GNorm = 0.0646, lr_0 = 9.9301e-04
Validation auc = 0.712892
Epoch 9868
Loss = 1.2942e-02, PNorm = 540.6473, GNorm = 0.1028, lr_0 = 9.9301e-04
Validation auc = 0.707081
Epoch 9869
Loss = 6.5730e-04, PNorm = 540.6688, GNorm = 0.0329, lr_0 = 9.9301e-04
Loss = 3.9482e-02, PNorm = 540.6913, GNorm = 0.0829, lr_0 = 9.9301e-04
Validation auc = 0.711165
Epoch 9870
Loss = 3.5857e-02, PNorm = 540.7139, GNorm = 0.2610, lr_0 = 9.9301e-04
Validation auc = 0.704826
Epoch 9871
Loss = 3.3451e-02, PNorm = 540.7341, GNorm = 0.2388, lr_0 = 9.9301e-04
Validation auc = 0.704770
Epoch 9872
Loss = 5.0015e-03, PNorm = 540.7617, GNorm = 0.0843, lr_0 = 9.9301e-04
Validation auc = 0.696979
Epoch 9873
Loss = 9.1268e-03, PNorm = 540.7831, GNorm = 0.0934, lr_0 = 9.9301e-04
Validation auc = 0.695361
Epoch 9874
Loss = 4.1347e-02, PNorm = 540.7961, GNorm = 0.0523, lr_0 = 9.9301e-04
Validation auc = 0.694574
Epoch 9875
Loss = 8.2389e-03, PNorm = 540.8079, GNorm = 0.5621, lr_0 = 9.9301e-04
Validation auc = 0.696269
Epoch 9876
Loss = 3.2568e-02, PNorm = 540.8230, GNorm = 0.0925, lr_0 = 9.9301e-04
Validation auc = 0.693972
Epoch 9877
Loss = 1.4352e-02, PNorm = 540.8444, GNorm = 0.2098, lr_0 = 9.9300e-04
Validation auc = 0.698875
Epoch 9878
Loss = 2.4267e-02, PNorm = 540.8718, GNorm = 0.7382, lr_0 = 9.9300e-04
Validation auc = 0.699060
Epoch 9879
Loss = 9.7374e-03, PNorm = 540.8975, GNorm = 0.2977, lr_0 = 9.9300e-04
Loss = 2.8233e-02, PNorm = 540.9179, GNorm = 1.0118, lr_0 = 9.9300e-04
Validation auc = 0.700477
Epoch 9880
Loss = 1.0534e-02, PNorm = 540.9402, GNorm = 0.3467, lr_0 = 9.9300e-04
Validation auc = 0.707505
Epoch 9881
Loss = 3.3212e-02, PNorm = 540.9618, GNorm = 0.0688, lr_0 = 9.9300e-04
Validation auc = 0.709960
Epoch 9882
Loss = 1.7200e-02, PNorm = 540.9834, GNorm = 0.1643, lr_0 = 9.9300e-04
Validation auc = 0.713530
Epoch 9883
Loss = 2.1110e-02, PNorm = 540.9981, GNorm = 2.6320, lr_0 = 9.9300e-04
Validation auc = 0.712012
Epoch 9884
Loss = 5.3470e-02, PNorm = 541.0154, GNorm = 0.4580, lr_0 = 9.9300e-04
Validation auc = 0.688263
Epoch 9885
Loss = 1.6324e-02, PNorm = 541.0389, GNorm = 0.0700, lr_0 = 9.9300e-04
Validation auc = 0.692369
Epoch 9886
Loss = 1.4979e-02, PNorm = 541.0763, GNorm = 0.4108, lr_0 = 9.9300e-04
Validation auc = 0.701024
Epoch 9887
Loss = 7.0388e-03, PNorm = 541.1098, GNorm = 0.2219, lr_0 = 9.9300e-04
Validation auc = 0.695362
Epoch 9888
Loss = 1.4415e-03, PNorm = 541.1350, GNorm = 0.0735, lr_0 = 9.9300e-04
Validation auc = 0.696727
Epoch 9889
Loss = 1.7975e-02, PNorm = 541.1588, GNorm = 0.8585, lr_0 = 9.9300e-04
Loss = 4.0472e-02, PNorm = 541.1902, GNorm = 0.2134, lr_0 = 9.9299e-04
Validation auc = 0.705304
Epoch 9890
Loss = 2.1507e-02, PNorm = 541.2144, GNorm = 1.3174, lr_0 = 9.9299e-04
Validation auc = 0.711466
Epoch 9891
Loss = 6.3168e-02, PNorm = 541.2336, GNorm = 1.4960, lr_0 = 9.9299e-04
Validation auc = 0.716036
Epoch 9892
Loss = 9.9953e-03, PNorm = 541.2593, GNorm = 0.7649, lr_0 = 9.9299e-04
Validation auc = 0.719492
Epoch 9893
Loss = 2.6971e-02, PNorm = 541.2829, GNorm = 1.0002, lr_0 = 9.9299e-04
Validation auc = 0.719217
Epoch 9894
Loss = 2.6531e-02, PNorm = 541.3060, GNorm = 0.2549, lr_0 = 9.9299e-04
Validation auc = 0.725783
Epoch 9895
Loss = 1.6584e-03, PNorm = 541.3335, GNorm = 0.0487, lr_0 = 9.9299e-04
Validation auc = 0.727260
Epoch 9896
Loss = 1.0051e-02, PNorm = 541.3517, GNorm = 0.1230, lr_0 = 9.9299e-04
Validation auc = 0.723141
Epoch 9897
Loss = 1.0769e-02, PNorm = 541.3698, GNorm = 0.7034, lr_0 = 9.9299e-04
Validation auc = 0.722953
Epoch 9898
Loss = 3.3742e-02, PNorm = 541.3846, GNorm = 1.2686, lr_0 = 9.9299e-04
Validation auc = 0.718823
Epoch 9899
Loss = 9.2464e-02, PNorm = 541.4007, GNorm = 2.7569, lr_0 = 9.9299e-04
Loss = 3.1919e-02, PNorm = 541.4250, GNorm = 0.3505, lr_0 = 9.9299e-04
Validation auc = 0.717931
Epoch 9900
Loss = 2.1591e-02, PNorm = 541.4522, GNorm = 0.2238, lr_0 = 9.9299e-04
Validation auc = 0.720901
Epoch 9901
Loss = 2.9883e-02, PNorm = 541.4737, GNorm = 0.6126, lr_0 = 9.9299e-04
Validation auc = 0.718464
Epoch 9902
Loss = 9.1229e-02, PNorm = 541.5079, GNorm = 3.1215, lr_0 = 9.9299e-04
Validation auc = 0.721213
Epoch 9903
Loss = 3.5633e-02, PNorm = 541.5498, GNorm = 0.5600, lr_0 = 9.9298e-04
Validation auc = 0.725657
Epoch 9904
Loss = 1.1220e-02, PNorm = 541.5863, GNorm = 1.4622, lr_0 = 9.9298e-04
Validation auc = 0.730611
Epoch 9905
Loss = 6.1479e-02, PNorm = 541.6141, GNorm = 0.6301, lr_0 = 9.9298e-04
Validation auc = 0.725076
Epoch 9906
Loss = 1.2902e-02, PNorm = 541.6407, GNorm = 0.0535, lr_0 = 9.9298e-04
Validation auc = 0.718205
Epoch 9907
Loss = 1.0798e-02, PNorm = 541.6605, GNorm = 0.7924, lr_0 = 9.9298e-04
Validation auc = 0.713344
Epoch 9908
Loss = 1.4715e-02, PNorm = 541.6771, GNorm = 1.6456, lr_0 = 9.9298e-04
Validation auc = 0.708502
Epoch 9909
Loss = 1.5177e-02, PNorm = 541.6914, GNorm = 0.9025, lr_0 = 9.9298e-04
Loss = 3.0987e-02, PNorm = 541.7066, GNorm = 1.3764, lr_0 = 9.9298e-04
Validation auc = 0.711903
Epoch 9910
Loss = 4.0143e-02, PNorm = 541.7296, GNorm = 0.1262, lr_0 = 9.9298e-04
Validation auc = 0.717536
Epoch 9911
Loss = 4.2344e-02, PNorm = 541.7620, GNorm = 2.3088, lr_0 = 9.9298e-04
Validation auc = 0.721059
Epoch 9912
Loss = 1.6802e-02, PNorm = 541.7905, GNorm = 0.3879, lr_0 = 9.9298e-04
Validation auc = 0.715208
Epoch 9913
Loss = 1.9640e-02, PNorm = 541.8258, GNorm = 0.3954, lr_0 = 9.9298e-04
Validation auc = 0.718562
Epoch 9914
Loss = 1.5811e-02, PNorm = 541.8579, GNorm = 1.2971, lr_0 = 9.9298e-04
Validation auc = 0.720023
Epoch 9915
Loss = 2.6292e-02, PNorm = 541.8824, GNorm = 0.1954, lr_0 = 9.9298e-04
Validation auc = 0.710094
Epoch 9916
Loss = 4.2312e-02, PNorm = 541.9106, GNorm = 1.4201, lr_0 = 9.9298e-04
Validation auc = 0.715409
Epoch 9917
Loss = 2.0612e-02, PNorm = 541.9452, GNorm = 2.2650, lr_0 = 9.9297e-04
Validation auc = 0.716572
Epoch 9918
Loss = 3.2305e-03, PNorm = 541.9726, GNorm = 0.2018, lr_0 = 9.9297e-04
Validation auc = 0.719245
Epoch 9919
Loss = 4.8593e-03, PNorm = 541.9964, GNorm = 0.2024, lr_0 = 9.9297e-04
Loss = 2.4269e-02, PNorm = 542.0166, GNorm = 2.7461, lr_0 = 9.9297e-04
Validation auc = 0.722847
Epoch 9920
Loss = 1.2362e-02, PNorm = 542.0366, GNorm = 0.1025, lr_0 = 9.9297e-04
Validation auc = 0.724830
Epoch 9921
Loss = 1.7896e-02, PNorm = 542.0561, GNorm = 0.1230, lr_0 = 9.9297e-04
Validation auc = 0.715938
Epoch 9922
Loss = 5.8557e-02, PNorm = 542.0799, GNorm = 0.1458, lr_0 = 9.9297e-04
Validation auc = 0.723136
Epoch 9923
Loss = 2.6916e-02, PNorm = 542.1088, GNorm = 0.2702, lr_0 = 9.9297e-04
Validation auc = 0.728336
Epoch 9924
Loss = 1.5842e-02, PNorm = 542.1313, GNorm = 0.1156, lr_0 = 9.9297e-04
Validation auc = 0.729732
Epoch 9925
Loss = 4.4626e-02, PNorm = 542.1541, GNorm = 2.1226, lr_0 = 9.9297e-04
Validation auc = 0.729145
Epoch 9926
Loss = 6.3783e-03, PNorm = 542.1851, GNorm = 0.1279, lr_0 = 9.9297e-04
Validation auc = 0.722153
Epoch 9927
Loss = 6.6035e-02, PNorm = 542.2137, GNorm = 0.1354, lr_0 = 9.9297e-04
Validation auc = 0.724418
Epoch 9928
Loss = 6.3220e-03, PNorm = 542.2431, GNorm = 0.0804, lr_0 = 9.9297e-04
Validation auc = 0.720925
Epoch 9929
Loss = 6.9298e-02, PNorm = 542.2666, GNorm = 2.2066, lr_0 = 9.9297e-04
Loss = 1.3439e-02, PNorm = 542.2847, GNorm = 0.1556, lr_0 = 9.9296e-04
Validation auc = 0.715862
Epoch 9930
Loss = 9.8540e-03, PNorm = 542.2989, GNorm = 0.1267, lr_0 = 9.9296e-04
Validation auc = 0.715497
Epoch 9931
Loss = 1.5330e-02, PNorm = 542.3139, GNorm = 0.2956, lr_0 = 9.9296e-04
Validation auc = 0.717030
Epoch 9932
Loss = 1.9565e-02, PNorm = 542.3349, GNorm = 0.8344, lr_0 = 9.9296e-04
Validation auc = 0.721713
Epoch 9933
Loss = 1.4223e-02, PNorm = 542.3581, GNorm = 0.0273, lr_0 = 9.9296e-04
Validation auc = 0.722280
Epoch 9934
Loss = 2.6569e-02, PNorm = 542.3770, GNorm = 0.5636, lr_0 = 9.9296e-04
Validation auc = 0.724420
Epoch 9935
Loss = 4.6982e-02, PNorm = 542.4010, GNorm = 2.0526, lr_0 = 9.9296e-04
Validation auc = 0.722295
Epoch 9936
Loss = 8.2669e-02, PNorm = 542.4321, GNorm = 1.2296, lr_0 = 9.9296e-04
Validation auc = 0.724469
Epoch 9937
Loss = 4.0670e-03, PNorm = 542.4668, GNorm = 0.3103, lr_0 = 9.9296e-04
Validation auc = 0.725071
Epoch 9938
Loss = 4.9839e-02, PNorm = 542.4915, GNorm = 0.5844, lr_0 = 9.9296e-04
Validation auc = 0.714806
Epoch 9939
Loss = 3.6180e-02, PNorm = 542.5120, GNorm = 2.3579, lr_0 = 9.9296e-04
Loss = 3.1448e-02, PNorm = 542.5391, GNorm = 0.4195, lr_0 = 9.9296e-04
Validation auc = 0.707594
Epoch 9940
Loss = 2.2701e-02, PNorm = 542.5601, GNorm = 0.7979, lr_0 = 9.9296e-04
Validation auc = 0.709032
Epoch 9941
Loss = 2.3469e-02, PNorm = 542.5789, GNorm = 0.3504, lr_0 = 9.9296e-04
Validation auc = 0.710593
Epoch 9942
Loss = 2.2391e-02, PNorm = 542.5991, GNorm = 1.1281, lr_0 = 9.9296e-04
Validation auc = 0.705781
Epoch 9943
Loss = 9.3865e-03, PNorm = 542.6368, GNorm = 0.3289, lr_0 = 9.9295e-04
Validation auc = 0.701737
Epoch 9944
Loss = 2.2044e-02, PNorm = 542.6648, GNorm = 0.2954, lr_0 = 9.9295e-04
Validation auc = 0.702817
Epoch 9945
Loss = 4.9117e-03, PNorm = 542.6908, GNorm = 0.0736, lr_0 = 9.9295e-04
Validation auc = 0.713477
Epoch 9946
Loss = 6.7206e-02, PNorm = 542.7238, GNorm = 3.1950, lr_0 = 9.9295e-04
Validation auc = 0.710506
Epoch 9947
Loss = 4.0028e-03, PNorm = 542.7669, GNorm = 0.1141, lr_0 = 9.9295e-04
Validation auc = 0.704083
Epoch 9948
Loss = 2.8473e-02, PNorm = 542.7964, GNorm = 0.4895, lr_0 = 9.9295e-04
Validation auc = 0.703530
Epoch 9949
Loss = 2.2040e-03, PNorm = 542.8175, GNorm = 0.1005, lr_0 = 9.9295e-04
Loss = 1.0706e-02, PNorm = 542.8367, GNorm = 0.3776, lr_0 = 9.9295e-04
Validation auc = 0.705634
Epoch 9950
Loss = 4.4158e-02, PNorm = 542.8514, GNorm = 4.7726, lr_0 = 9.9295e-04
Validation auc = 0.695105
Epoch 9951
Loss = 2.2862e-02, PNorm = 542.8639, GNorm = 0.4119, lr_0 = 9.9295e-04
Validation auc = 0.690825
Epoch 9952
Loss = 2.2447e-02, PNorm = 542.8790, GNorm = 0.0426, lr_0 = 9.9295e-04
Validation auc = 0.699570
Epoch 9953
Loss = 3.4552e-02, PNorm = 542.9027, GNorm = 0.0559, lr_0 = 9.9295e-04
Validation auc = 0.699265
Epoch 9954
Loss = 3.9656e-02, PNorm = 542.9363, GNorm = 1.3631, lr_0 = 9.9295e-04
Validation auc = 0.684576
Epoch 9955
Loss = 9.7338e-03, PNorm = 542.9615, GNorm = 0.3569, lr_0 = 9.9295e-04
Validation auc = 0.686986
Epoch 9956
Loss = 2.4459e-02, PNorm = 542.9885, GNorm = 0.1601, lr_0 = 9.9295e-04
Validation auc = 0.689145
Epoch 9957
Loss = 3.3279e-02, PNorm = 543.0114, GNorm = 1.5493, lr_0 = 9.9294e-04
Validation auc = 0.688686
Epoch 9958
Loss = 6.3586e-02, PNorm = 543.0350, GNorm = 0.9241, lr_0 = 9.9294e-04
Validation auc = 0.705903
Epoch 9959
Loss = 1.7758e-04, PNorm = 543.0674, GNorm = 0.0122, lr_0 = 9.9294e-04
Loss = 2.3415e-02, PNorm = 543.0890, GNorm = 1.8301, lr_0 = 9.9294e-04
Validation auc = 0.709885
Epoch 9960
Loss = 2.3246e-02, PNorm = 543.1059, GNorm = 0.2387, lr_0 = 9.9294e-04
Validation auc = 0.707727
Epoch 9961
Loss = 1.5461e-02, PNorm = 543.1222, GNorm = 0.6815, lr_0 = 9.9294e-04
Validation auc = 0.701644
Epoch 9962
Loss = 4.2852e-02, PNorm = 543.1368, GNorm = 0.8326, lr_0 = 9.9294e-04
Validation auc = 0.693485
Epoch 9963
Loss = 2.1587e-02, PNorm = 543.1548, GNorm = 1.2817, lr_0 = 9.9294e-04
Validation auc = 0.695359
Epoch 9964
Loss = 2.3270e-02, PNorm = 543.1737, GNorm = 0.0582, lr_0 = 9.9294e-04
Validation auc = 0.697577
Epoch 9965
Loss = 1.6565e-02, PNorm = 543.1930, GNorm = 1.0917, lr_0 = 9.9294e-04
Validation auc = 0.697212
Epoch 9966
Loss = 3.3001e-02, PNorm = 543.2126, GNorm = 0.0970, lr_0 = 9.9294e-04
Validation auc = 0.704838
Epoch 9967
Loss = 3.8289e-03, PNorm = 543.2326, GNorm = 0.4112, lr_0 = 9.9294e-04
Validation auc = 0.700599
Epoch 9968
Loss = 2.6616e-02, PNorm = 543.2499, GNorm = 0.1040, lr_0 = 9.9294e-04
Validation auc = 0.695868
Epoch 9969
Loss = 4.6409e-03, PNorm = 543.2699, GNorm = 0.1563, lr_0 = 9.9294e-04
Loss = 2.5095e-02, PNorm = 543.2934, GNorm = 0.1458, lr_0 = 9.9293e-04
Validation auc = 0.697135
Epoch 9970
Loss = 3.8171e-03, PNorm = 543.3131, GNorm = 0.8468, lr_0 = 9.9293e-04
Validation auc = 0.705123
Epoch 9971
Loss = 1.4960e-02, PNorm = 543.3282, GNorm = 0.4194, lr_0 = 9.9293e-04
Validation auc = 0.705685
Epoch 9972
Loss = 4.5864e-02, PNorm = 543.3510, GNorm = 3.4283, lr_0 = 9.9293e-04
Validation auc = 0.706277
Epoch 9973
Loss = 5.4866e-02, PNorm = 543.3909, GNorm = 1.6184, lr_0 = 9.9293e-04
Validation auc = 0.708088
Epoch 9974
Loss = 5.9637e-03, PNorm = 543.4365, GNorm = 0.2852, lr_0 = 9.9293e-04
Validation auc = 0.709737
Epoch 9975
Loss = 2.4164e-02, PNorm = 543.4644, GNorm = 0.5040, lr_0 = 9.9293e-04
Validation auc = 0.709006
Epoch 9976
Loss = 1.1880e-02, PNorm = 543.4862, GNorm = 0.3623, lr_0 = 9.9293e-04
Validation auc = 0.705003
Epoch 9977
Loss = 2.7988e-02, PNorm = 543.5090, GNorm = 1.2702, lr_0 = 9.9293e-04
Validation auc = 0.703639
Epoch 9978
Loss = 4.6082e-02, PNorm = 543.5343, GNorm = 0.9183, lr_0 = 9.9293e-04
Validation auc = 0.698056
Epoch 9979
Loss = 6.6722e-03, PNorm = 543.5577, GNorm = 0.6352, lr_0 = 9.9293e-04
Loss = 2.0959e-02, PNorm = 543.5796, GNorm = 0.0873, lr_0 = 9.9293e-04
Validation auc = 0.696025
Epoch 9980
Loss = 1.5682e-02, PNorm = 543.6003, GNorm = 0.8095, lr_0 = 9.9293e-04
Validation auc = 0.697337
Epoch 9981
Loss = 1.8387e-02, PNorm = 543.6194, GNorm = 0.3492, lr_0 = 9.9293e-04
Validation auc = 0.693043
Epoch 9982
Loss = 2.5518e-02, PNorm = 543.6358, GNorm = 0.0704, lr_0 = 9.9293e-04
Validation auc = 0.696525
Epoch 9983
Loss = 1.4451e-02, PNorm = 543.6519, GNorm = 1.8803, lr_0 = 9.9292e-04
Validation auc = 0.696805
Epoch 9984
Loss = 1.6368e-02, PNorm = 543.6729, GNorm = 1.3026, lr_0 = 9.9292e-04
Validation auc = 0.700223
Epoch 9985
Loss = 4.6222e-02, PNorm = 543.6920, GNorm = 0.8520, lr_0 = 9.9292e-04
Validation auc = 0.694035
Epoch 9986
Loss = 1.3003e-02, PNorm = 543.7162, GNorm = 0.3012, lr_0 = 9.9292e-04
Validation auc = 0.693032
Epoch 9987
Loss = 7.1918e-02, PNorm = 543.7497, GNorm = 2.0703, lr_0 = 9.9292e-04
Validation auc = 0.703866
Epoch 9988
Loss = 4.8775e-02, PNorm = 543.7854, GNorm = 1.5015, lr_0 = 9.9292e-04
Validation auc = 0.711402
Epoch 9989
Loss = 1.7802e-01, PNorm = 543.8194, GNorm = 3.2712, lr_0 = 9.9292e-04
Loss = 2.3599e-02, PNorm = 543.8479, GNorm = 0.1324, lr_0 = 9.9292e-04
Validation auc = 0.711038
Epoch 9990
Loss = 3.3372e-02, PNorm = 543.8735, GNorm = 0.5921, lr_0 = 9.9292e-04
Validation auc = 0.711752
Epoch 9991
Loss = 1.3413e-02, PNorm = 543.8940, GNorm = 0.8974, lr_0 = 9.9292e-04
Validation auc = 0.713932
Epoch 9992
Loss = 2.6263e-02, PNorm = 543.9108, GNorm = 0.9834, lr_0 = 9.9292e-04
Validation auc = 0.714423
Epoch 9993
Loss = 2.3089e-02, PNorm = 543.9299, GNorm = 1.4991, lr_0 = 9.9292e-04
Validation auc = 0.716416
Epoch 9994
Loss = 3.3772e-03, PNorm = 543.9462, GNorm = 0.0131, lr_0 = 9.9292e-04
Validation auc = 0.718884
Epoch 9995
Loss = 2.7397e-03, PNorm = 543.9549, GNorm = 0.0744, lr_0 = 9.9292e-04
Validation auc = 0.717863
Epoch 9996
Loss = 1.0037e-02, PNorm = 543.9614, GNorm = 0.5326, lr_0 = 9.9291e-04
Validation auc = 0.708581
Epoch 9997
Loss = 5.2485e-02, PNorm = 543.9747, GNorm = 0.9121, lr_0 = 9.9291e-04
Validation auc = 0.712459
Epoch 9998
Loss = 8.9677e-02, PNorm = 543.9942, GNorm = 3.1819, lr_0 = 9.9291e-04
Validation auc = 0.712819
Epoch 9999
Loss = 9.5014e-03, PNorm = 544.0226, GNorm = 0.4257, lr_0 = 9.9291e-04
Loss = 1.3626e-02, PNorm = 544.0489, GNorm = 1.7813, lr_0 = 9.9291e-04
Validation auc = 0.714251
Model 0 best validation auc = 0.776873 on epoch 3365
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Moving model to cuda
Model 0 test auc = 0.746221
Ensemble test auc = 0.746221
1-fold cross validation
	Seed 0 ==> test auc = 0.746221
Overall test auc = 0.746221 +/- 0.000000
Elapsed time = 2 days, 4:53:36
